-- Logs begin at Thu 2022-05-12 13:40:50 UTC, end at Thu 2022-05-12 14:56:05 UTC. -- May 12 14:22:14.313278 dv-cinder-777031-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 14:22:14.322527 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 14:22:14.324545 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 14:22:14 2022] *** May 12 14:22:14.324545 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 14:22:14.324545 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 14:22:14.324545 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: nodename: dv-cinder-777031-14-iscsi May 12 14:22:14.324545 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: machine: x86_64 May 12 14:22:14.324545 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: clock source: unix May 12 14:22:14.324545 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: pcre jit disabled May 12 14:22:14.324545 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: detected number of CPU cores: 4 May 12 14:22:14.324545 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: current working directory: / May 12 14:22:14.324545 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: detected binary path: /usr/bin/uwsgi-core May 12 14:22:14.325255 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: your processes number limit is 47680 May 12 14:22:14.325255 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: your memory page size is 4096 bytes May 12 14:22:14.325255 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: detected max file descriptor number: 2048 May 12 14:22:14.325255 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: lock engine: pthread robust mutexes May 12 14:22:14.325255 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: thunder lock: enabled May 12 14:22:14.325255 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 14:22:14.325255 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 14:22:14.370160 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: Python main interpreter initialized at 0x5642070129c0 May 12 14:22:14.370160 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: python threads support enabled May 12 14:22:14.370160 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: your server socket listen backlog is limited to 100 connections May 12 14:22:14.370160 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: your mercy for graceful operations on workers is 90 seconds May 12 14:22:14.370611 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: mapped 403077 bytes (393 KB) for 2 cores May 12 14:22:14.370611 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: *** Operational MODE: preforking *** May 12 14:22:14.370856 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: *** uWSGI is running in multiple interpreter mode *** May 12 14:22:14.370856 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: spawned uWSGI master process (pid: 102652) May 12 14:22:14.371097 dv-cinder-777031-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 14:22:14.371949 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: spawned uWSGI worker 1 (pid: 102653, cores: 1) May 12 14:22:14.372071 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: spawned uWSGI worker 2 (pid: 102654, cores: 1) May 12 14:22:14.373433 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 14:22:15.575106 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 14:22:15.592435 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 14:22:16.317928 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:22:16.317928 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: from cryptography.utils import int_from_bytes May 12 14:22:16.318198 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:22:16.318198 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: from cryptography.utils import int_from_bytes May 12 14:22:16.321825 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:22:16.321825 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: from cryptography.utils import int_from_bytes May 12 14:22:16.322150 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:22:16.322150 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: from cryptography.utils import int_from_bytes May 12 14:22:18.999181 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:22:18.999757 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:22:18.999857 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:22:18.999857 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:22:19.000295 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:22:19.000386 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:22:19.000477 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:22:19.000638 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:22:19.000730 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:22:19.001041 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.001140 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:22:19.001945 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.002119 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.002261 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.002449 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.002579 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.002780 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.002911 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.003132 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.003236 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.003471 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.003567 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.003785 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.003874 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.006348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.006493 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.006493 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.006664 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.006756 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.006846 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.006846 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.006998 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-777031-14-iscsi {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.007100 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.007201 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.007290 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-777031-14-iscsi {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.007376 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.007376 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.007529 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.007609 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.007696 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.007833 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.007953 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.008061 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.008174 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.008287 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.008408 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.008408 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.008640 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.008777 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.008885 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.009010 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.009150 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.009274 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.009397 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.009529 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.009662 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.009800 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.009928 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.010212 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.010332 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.010457 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.010593 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.010717 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.010846 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.010978 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.011124 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.011260 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.011395 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.011527 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.011651 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-777031-14-iscsi {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.011775 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.011911 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.012043 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-777031-14-iscsi {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.012168 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.012291 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.012427 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.012552 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.012674 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.012808 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.012947 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.013083 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.013208 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.013578 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.013717 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.013843 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.013983 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.014152 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.014283 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.014475 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.014612 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.014783 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.014924 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.015120 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.015262 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.015433 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.015572 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.015716 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.015850 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.016012 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.016149 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.016314 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.016443 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.016629 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.016758 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.016957 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.017085 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.017273 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.017410 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.017543 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.017677 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.017803 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.017934 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.018105 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.018242 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.018413 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.018542 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.018728 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.018872 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.019109 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.019253 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.019381 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.019515 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.019651 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.019777 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.019988 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.020140 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.020397 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.020535 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.020661 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.020794 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.020926 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.021051 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.021174 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.021306 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.021441 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.021580 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.021714 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.021848 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.021973 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.022096 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.022219 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.022351 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.022477 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.022613 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.022738 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.022862 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.023068 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.023217 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.023359 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.023484 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.023676 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.023855 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.024024 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.024258 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.024399 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.024525 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.024657 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.024782 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.024919 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.025044 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.025213 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.025363 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.025500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.025627 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.025817 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.025950 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.026135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.026270 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.026438 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.026566 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.026739 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.026868 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.027055 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.027209 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.027382 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.027510 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.027687 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.027815 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.027988 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.028122 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.028255 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.028389 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.028514 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.028638 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.028808 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.028943 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.029121 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.029263 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.029425 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.029553 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.029724 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.029859 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.030026 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.030169 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.030452 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.030599 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.030725 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.030849 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.030973 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.031149 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.031285 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.031410 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.031534 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.031665 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.031900 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.032041 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.032166 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.032290 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.032470 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.032600 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.032813 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.032947 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.033112 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.033239 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.033417 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.033556 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.033723 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.033852 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.034024 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.034151 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.034326 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.034454 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.034630 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.034760 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.034933 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.035117 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.035256 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.035390 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.035558 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.035674 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.035859 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.035993 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.036176 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.036309 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.036476 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.036603 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.036777 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.036908 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.037199 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.037384 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.037384 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.037646 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.037772 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.037896 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.038019 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.038143 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.038316 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.038445 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.038577 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.038702 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.038849 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.038987 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.039179 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.039321 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.039483 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.039619 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.039783 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.039921 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.040083 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.040212 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.040390 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.040663 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.040793 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.040926 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.041051 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.041175 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.041307 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.041433 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.041557 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.041690 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.041840 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.041969 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.042156 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.042297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.042463 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.042613 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.042751 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.042876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.043100 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.043234 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.043377 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.043505 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.043712 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.043841 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.044040 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.044168 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:22:19.044382 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.044513 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.044693 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.044821 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.045021 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.045151 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.045344 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.045473 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.045656 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.045791 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.045967 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.046174 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.046302 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.046426 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.046628 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.046787 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.046914 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.047066 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.047240 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.047368 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.047570 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.047702 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.047888 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.048029 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.048733 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.048873 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.049063 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.049213 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.049376 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.049515 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.049688 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.049825 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.050002 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.050131 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.050308 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.050446 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.050728 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.050867 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.051002 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.051152 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.051290 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.051425 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.051572 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.051701 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.051909 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.052038 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.052244 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.052372 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.052552 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.052690 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.052874 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.053004 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.053195 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.053345 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.053502 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.053631 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.053808 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.053937 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.054113 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.054251 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.054430 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.054560 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.054737 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.054865 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.055079 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.055224 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.055400 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.055530 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.055710 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.055850 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.056018 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.056156 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.056324 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.056452 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.056631 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.056770 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.056937 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.057068 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.057245 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.057372 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.057556 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.057699 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.057863 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.057993 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.058172 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.058310 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.058486 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.058626 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.058797 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.058925 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.059134 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.059266 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.059443 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.059582 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.059745 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.059875 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.060047 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.060183 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.060349 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.060485 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.060651 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.060926 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.061055 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.061179 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.061319 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.061445 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.061569 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.061693 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.061848 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.061978 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.062177 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.062316 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.062479 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.062608 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.062814 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.062941 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.063205 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.063330 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.063501 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.063629 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.063853 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.064530 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.064735 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.064865 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.065052 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.065190 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.065370 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.065514 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.065685 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.065813 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.065994 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.066122 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.066295 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.066432 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.066616 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.066758 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.066919 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.067075 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.067256 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.067402 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.067564 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.067691 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.067870 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.068007 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.068180 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.068310 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.068488 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.068627 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.068795 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.068923 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.069105 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.069241 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.069411 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.069538 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.069719 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.069852 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.070057 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.070185 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.070336 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.070465 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.070656 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.070785 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.071149 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.071282 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.071407 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.071530 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.071655 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.071794 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.071920 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.072053 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.072186 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.072312 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.072484 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.072623 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.072787 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.072922 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.073089 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.073217 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.073392 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.073531 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.073692 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.073822 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.073991 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.074120 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.074293 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.074436 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.074594 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.074722 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.074892 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.075020 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.075220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.075358 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.075526 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.075655 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.075823 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.075961 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.076106 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.076232 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.076410 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.076540 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.076725 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.076860 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.077032 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.077168 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.077366 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.077500 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.077672 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.077800 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.078002 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.078137 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.078320 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.078449 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.078632 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.078774 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.078943 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.079102 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.079277 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.079439 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.079613 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.079752 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.079924 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.080052 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.080229 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.080356 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.080541 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.080682 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.080853 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.080995 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.081261 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.081394 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.081520 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.081654 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.081780 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.081905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.082063 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.082199 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.082379 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.082509 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.082681 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.082818 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.082992 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.083155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.083328 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.083457 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.083646 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.083775 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.083969 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.084096 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.084290 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.084420 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.084596 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.084732 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.084905 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.085048 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.085260 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.085408 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.085536 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.085659 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.085784 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.085907 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.086088 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.086225 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.086399 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.086528 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.086702 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.086839 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.087013 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.087192 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.087341 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.087471 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.087659 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.087806 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.087963 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.088092 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.088276 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.088412 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.088577 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.088716 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.088883 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.089019 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.089205 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.089333 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.089516 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.089653 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.089828 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.089956 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.090136 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.090264 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.090452 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.090582 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.090760 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.090895 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.091081 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.091356 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.091510 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.091650 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.091778 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.091910 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.092036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.092160 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.092294 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.092420 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.092544 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.092668 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.092846 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.092976 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.093154 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.093285 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.093458 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.093595 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.093764 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.093900 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.094069 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.094198 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.094415 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.094589 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.094730 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.095004 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.095226 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.095354 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.095478 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.095659 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.095807 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.095977 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.096116 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.096291 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.096419 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.096593 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.097032 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.097166 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.097274 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.097381 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.097506 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.097631 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.097754 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.097898 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.098033 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.098171 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.098304 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.098437 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.098642 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.098770 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.098895 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.099020 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.099175 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.099300 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.099438 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.099566 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.099690 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.099871 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.100001 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.100176 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.100318 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.100489 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.100629 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.100799 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.100928 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.101103 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.101242 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.101523 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.101655 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.101790 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.101916 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.102049 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.102176 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.102307 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.102431 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.102585 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.102713 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.102891 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.103022 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.103216 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.103342 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.103531 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.103672 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.103835 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.103965 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.104141 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.104270 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.104446 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.104574 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.104840 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.104984 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.105144 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.105282 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.105456 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.105595 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.105762 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.106073 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.106200 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.106390 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.106519 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.106732 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.106961 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.107109 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.107321 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.107464 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.107639 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.107777 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.107957 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.108086 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.108275 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.108404 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.108593 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.108723 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.108901 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.109043 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.109208 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.109350 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.109511 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.109639 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.109814 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.109957 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.110120 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.110248 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.110417 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.110548 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.111282 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.111428 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.111713 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.111843 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.111977 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.112112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.112239 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.112374 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.112509 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.112636 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.112761 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.112886 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.113026 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.113154 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.113325 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.113458 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.113623 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.113755 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.113931 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.114070 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.114231 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.114360 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.114535 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.114664 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.114844 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.114973 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.115168 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.115311 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.115472 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.115609 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.115772 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.115903 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.116079 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.116207 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.116386 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.116525 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.116690 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.116820 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.117029 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.117158 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.117334 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.117472 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.117654 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.117783 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.117956 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.118085 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.118275 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.118418 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.118575 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.118712 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.118875 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.119007 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.119238 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.119369 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.119546 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.119676 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.119852 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.119973 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.120150 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.120279 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.120458 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.120586 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.120764 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.120891 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.121067 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.121195 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.121371 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.121498 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.121776 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.121923 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.122059 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.122194 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.122321 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.122446 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.122571 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.122771 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.122899 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.123111 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.123242 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.123367 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.123494 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.123629 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.123757 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.123931 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.124069 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.124201 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.124319 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.124440 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.124589 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.124719 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.124886 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.125016 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.125199 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.125339 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.125498 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.125627 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.125795 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.125924 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.126095 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.126225 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.126952 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.127108 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.127296 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.127426 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.127600 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.127728 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.127907 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.128034 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.128215 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.128343 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.128514 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.128643 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.128816 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.128952 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.129120 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.129249 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.129420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.129558 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.129718 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.129847 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.130023 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.130143 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.130327 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.130458 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.130629 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.130765 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.130931 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.131129 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.131258 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.131383 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.131546 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.131676 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.131946 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.132087 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.132222 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.132349 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.132473 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.132606 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.132732 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.132865 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.132991 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.133115 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.133272 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.133402 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.133571 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.133702 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.133869 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.133999 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.134186 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.134317 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.134489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.134626 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.134784 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.134914 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.135109 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.135253 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.135412 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.135543 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.135714 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.135843 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.136018 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.136157 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.136322 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.136453 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.136663 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.136792 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.136966 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.137103 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.137279 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.137406 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.137588 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.137716 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.137897 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.138040 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.138206 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.138629 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.138758 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.138884 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.139101 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.139248 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.139376 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.139509 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.139687 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.139817 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.139987 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.140125 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.140289 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.140426 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.140597 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.140733 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.140905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.141044 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.141210 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.141340 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.141525 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.141795 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.142080 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.142214 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.142346 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.142472 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.142597 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.142721 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.142855 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.142981 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.143124 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.143249 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.143373 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.143545 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.143687 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.143855 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.143985 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.144167 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.144296 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.144476 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.144615 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.144787 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.144917 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.145096 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.145227 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.145408 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.145538 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.145719 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.145851 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.146026 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.146163 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.146335 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.146465 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.146653 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.146785 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.146939 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.147130 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.147280 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.147415 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.147565 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.147693 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.147869 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.147997 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.148166 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.148303 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.148474 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.148610 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.148776 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.148918 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.149082 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.149210 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.149387 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.149516 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.149698 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.149837 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.150004 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.150133 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.150394 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.150536 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.150706 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.150844 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.151016 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.151162 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.151349 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.151480 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.151652 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.151874 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.152095 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.152294 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.152424 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.152550 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.152684 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.152811 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.152944 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.153069 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.153224 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.153360 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.153524 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.153656 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.153828 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.153958 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.154147 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.154284 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.154445 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.154577 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.154745 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.154874 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.155105 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.155239 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.155379 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.155515 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.155673 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.155802 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.155973 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.156110 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.156279 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.156408 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.156672 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.156816 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.156943 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.157077 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.157204 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.157358 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.158161 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.158297 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.158472 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.158611 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.158777 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.158907 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.159123 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.159253 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.159446 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.159590 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.159748 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.159879 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.160058 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.160195 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.160362 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.160513 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.160682 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.160827 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.161000 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.161130 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.161311 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.161448 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.161620 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.161749 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.161918 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.162062 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.162280 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.162473 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.162678 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.162807 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.162932 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.163081 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.163210 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.163348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.163474 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.163607 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.163789 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.163920 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.164103 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.164239 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.164426 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.164556 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.164762 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.164890 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.165062 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.165201 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.165359 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.165496 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.165660 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.165789 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.165959 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.166097 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.166259 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.166388 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.166575 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.166704 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.166886 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.167024 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.167232 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.167363 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.167535 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.167672 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.167835 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.167972 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.168135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.168273 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.168433 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.168563 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.168740 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.168877 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.169035 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.169163 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.169333 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.169460 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.169634 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.169765 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.169947 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.170075 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.170248 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.170377 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.170551 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.170681 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.170869 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.171012 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.171224 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.171350 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.171490 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.171617 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.171773 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.171911 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.172072 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.172212 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.172418 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.172621 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.172757 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.172892 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.173019 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.173173 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.173362 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.173987 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.174190 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.174320 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.174505 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.174650 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.174826 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.174956 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.175182 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.175326 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.175502 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.175649 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.175814 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.175942 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.176131 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.176267 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.176431 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.176561 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.176731 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.176860 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.177036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.177165 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.177335 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.177474 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.177636 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.177766 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.177936 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.178065 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.178239 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.178368 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.178536 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.178665 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.178833 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.178975 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.179176 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.179316 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.179465 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.179595 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.179764 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.179911 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.180067 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.180196 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.180369 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.180505 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.180668 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.180808 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.180968 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.181105 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.181271 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.181402 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.181589 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.181730 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.181893 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.182028 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.182198 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.182334 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.182546 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.182760 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.182890 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.183013 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.183165 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.183302 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.183438 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.183563 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.183758 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.183888 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.184071 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.184192 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.184381 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.184511 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.184691 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.184820 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.185002 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.185133 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.185333 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.185457 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.185616 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.185744 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.185925 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.186054 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.186230 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.186369 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.186540 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.186668 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.186849 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.186987 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.187171 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.187309 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.187484 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.187734 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.187899 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.188063 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.188196 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.188377 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.188507 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.188686 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.188968 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.189108 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.189299 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.189428 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.189611 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.189739 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.189918 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.190059 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.190227 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.190358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.190534 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.190671 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.190839 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.190969 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.191173 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.191304 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.191486 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.191628 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.191834 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.191963 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.192088 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.192214 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.192413 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.192558 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.192782 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.192977 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.193106 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.193240 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.193375 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.193511 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.193671 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.193807 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.193982 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.194112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.194286 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.194426 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.194597 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.194727 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.194909 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.195080 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.195247 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.195379 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.195556 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.195686 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.195863 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.195992 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.196173 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.196303 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.196484 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.196613 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.196789 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.196933 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.197095 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.197225 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.197402 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.197531 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.197712 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.197849 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.198026 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.198155 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.198337 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.198467 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.198652 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.198791 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.198958 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.199105 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.199296 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.199425 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.199609 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.199739 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.199936 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.200127 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.200264 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.200437 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.200580 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.200781 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.200902 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.201103 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.201357 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.201495 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.201673 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.201804 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.202007 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.202136 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.202333 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.202463 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.202632 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.202774 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.202987 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.203180 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.203310 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.203444 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.203578 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.203704 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.203829 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.203954 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.204133 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.204273 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.204461 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.204600 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.204764 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.204902 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.205078 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.205220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.205383 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.205521 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.205713 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.205915 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.206047 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.206263 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.206393 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.206573 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.206702 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.206892 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.207175 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.207321 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.207532 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.207662 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.207834 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.207961 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.208243 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.208394 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.208523 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.208648 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.208773 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.208906 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.209042 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.209177 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.209338 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.209469 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.209640 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.209770 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.209942 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.210073 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.210248 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.210377 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.210553 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.210692 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.210854 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.210983 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.211170 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.211297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.211474 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.211622 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.211799 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.211929 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.212102 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.212231 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.212404 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.212543 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.212708 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.212883 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.213118 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.213241 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.213367 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.213508 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.213636 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.213762 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.213887 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.214013 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.214147 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.214275 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.214452 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.214583 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.214753 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.214891 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.215078 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.215210 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.215383 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.215524 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.215688 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.215816 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.215988 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.216118 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.216291 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.216420 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.216592 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.216721 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.216904 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.217035 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.217209 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.217351 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.217516 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.217654 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.217830 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.217966 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.218136 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.218273 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.218454 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.218593 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.218760 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.218889 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.219087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.219220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.219404 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.219542 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.219730 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.219867 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.220575 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.220862 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.220999 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.221202 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.221339 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.221512 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.221650 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.221848 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.222065 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.222195 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.222402 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.222540 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.222723 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.222854 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.223112 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.223250 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.223379 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.223506 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.223688 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.223819 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.224011 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.224149 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.224276 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.224400 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.224585 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.224704 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.224869 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.225001 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.225174 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.225304 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.225480 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.225622 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.225785 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.225915 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.226091 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.226220 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.226391 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.226528 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.226694 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.226825 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.226997 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.227178 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.227330 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.227471 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.227640 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.227812 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.227941 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.228075 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.228246 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.228377 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.228558 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.228686 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.228870 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.228999 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.229177 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.229307 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.229496 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.229624 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.229802 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.229931 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.230108 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.230239 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.230417 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.230546 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.230728 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.230871 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.231056 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.231189 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.231368 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.231497 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.231683 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.231824 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.232027 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.232166 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.232342 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.232472 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.232648 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.232787 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.232979 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.233109 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.233316 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.233445 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.233602 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.233734 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.233908 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.234036 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.234233 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.234362 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.234539 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.234665 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.234865 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.235079 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.235235 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.235413 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.235557 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.236274 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.236605 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.236746 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.236956 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.237100 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.237266 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.237397 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.237597 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.237862 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.238041 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.238217 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.238376 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.238534 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.238728 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.238887 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.239119 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.239284 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.239284 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.239575 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.239732 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.239879 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.240035 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.240188 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.240341 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.240485 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.240639 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.240784 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.240942 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.241088 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.241249 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.241421 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.241587 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.241741 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.241896 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.242041 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.242187 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.242332 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.242477 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.242622 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.242776 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.242926 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.243119 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.243269 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.243517 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.243689 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.243850 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.243997 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.244141 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.244292 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.244437 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.244592 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.244744 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.244906 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.245081 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.245248 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.245394 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.245550 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.245695 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.245842 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.245986 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.246131 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.246276 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.246430 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.246591 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.246808 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.246973 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.247185 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.247343 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.247490 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.247636 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.247779 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.247931 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.248075 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.248230 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.248383 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.248528 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.248672 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.248817 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.248969 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.249124 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.249124 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.249408 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.249552 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.249696 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.249848 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.250006 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.250153 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.250320 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.250473 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.250619 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.250859 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.251008 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.251192 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.251342 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.251498 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.251672 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.251857 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.252011 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.252157 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.252157 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.252437 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.252590 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.252749 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.252899 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.253045 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.253045 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.253329 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.253498 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.253728 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.253875 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.254027 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.254173 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.254320 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.254473 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.254617 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.254787 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.254942 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.255145 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.255316 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.255475 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.255620 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.255765 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.255909 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.256053 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.256207 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.256354 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.256498 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.256653 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.256804 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.256949 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.257102 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.257263 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.257421 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.257581 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.257734 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.257891 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.258045 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.258190 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.258334 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.258480 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.258629 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.258783 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.258936 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.259205 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.259354 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:22:19.259510 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.259510 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.259804 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.259956 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.260264 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:22:19.260512 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:22:19.284569 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_db.sqlalchemy.engines [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:22:19.286559 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG oslo_db.sqlalchemy.engines [None req-fb35fbe5-e127-4128-b337-5c40b055b1be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102653) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:22:19.349132 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.context [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c0b44fa-5cb1-4cc9-b975-38d3ec19564b(cell1) {{(pid=102654) load_cells /opt/stack/nova/nova/context.py:464}} May 12 14:22:19.350973 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.context [None req-fb35fbe5-e127-4128-b337-5c40b055b1be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c0b44fa-5cb1-4cc9-b975-38d3ec19564b(cell1) {{(pid=102653) load_cells /opt/stack/nova/nova/context.py:464}} May 12 14:22:19.353557 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:22:19.355171 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:22:19.355364 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG oslo_concurrency.lockutils [None req-fb35fbe5-e127-4128-b337-5c40b055b1be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:22:19.355980 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:22:19.356945 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG oslo_concurrency.lockutils [None req-fb35fbe5-e127-4128-b337-5c40b055b1be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:22:19.357741 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG oslo_concurrency.lockutils [None req-fb35fbe5-e127-4128-b337-5c40b055b1be None None] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:22:19.357919 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:22:19.359715 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG oslo_concurrency.lockutils [None req-fb35fbe5-e127-4128-b337-5c40b055b1be None None] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:22:19.373060 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG oslo_db.sqlalchemy.engines [None req-fb35fbe5-e127-4128-b337-5c40b055b1be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102653) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:22:19.374636 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_db.sqlalchemy.engines [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:22:19.378681 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG oslo_db.sqlalchemy.engines [None req-fb35fbe5-e127-4128-b337-5c40b055b1be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102653) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:22:19.386170 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_db.sqlalchemy.engines [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:22:19.546120 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG oslo_db.sqlalchemy.engines [None req-fb35fbe5-e127-4128-b337-5c40b055b1be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102653) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:22:19.548515 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_db.sqlalchemy.engines [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:22:19.891747 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: WARNING keystonemiddleware.auth_token [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:22:19.899347 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: WARNING keystonemiddleware.auth_token [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:22:19.930500 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: WARNING keystonemiddleware.auth_token [None req-fb35fbe5-e127-4128-b337-5c40b055b1be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:22:19.938120 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: WARNING keystonemiddleware.auth_token [None req-fb35fbe5-e127-4128-b337-5c40b055b1be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:22:20.255163 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: WARNING keystonemiddleware.auth_token [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:22:20.261230 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: WARNING keystonemiddleware.auth_token [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:22:20.268295 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5642070129c0 pid: 102654 (default app) May 12 14:22:20.270526 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:22:20.271906 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] 10.222.0.75 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001986 May 12 14:22:20.272376 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 788 bytes} [Thu May 12 14:22:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:22:20.300505 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: WARNING keystonemiddleware.auth_token [None req-fb35fbe5-e127-4128-b337-5c40b055b1be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:22:20.306734 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: WARNING keystonemiddleware.auth_token [None req-fb35fbe5-e127-4128-b337-5c40b055b1be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:22:20.313045 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5642070129c0 pid: 102653 (default app) May 12 14:23:40.257986 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:23:40.259641 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 May 12 14:23:40.271286 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 2/2] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 12 14:23:40 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:23:40.673911 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-35a1728e-b9ba-48cf-bdc6-128338ca3b99 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:23:40.703236 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-35a1728e-b9ba-48cf-bdc6-128338ca3b99 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.435241 May 12 14:23:40.703883 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 1/3] 10.222.0.75 () {60 vars in 1291 bytes} [Thu May 12 14:23:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:23:42.992095 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:23:42.993222 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-e854c1ca-0310-484a-9497-10faf94d8967 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 May 12 14:23:42.994318 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 3/4] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 12 14:23:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:23:43.058834 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-ac4a5934-175b-46a3-b57c-bb2897e37cd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "c1", "name": "cirros256", "disk": 1, "ram": 256}} {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:23:43.085300 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:23:43.085300 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: warnings.warn(msg) May 12 14:23:43.116855 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-ac4a5934-175b-46a3-b57c-bb2897e37cd6 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.116128 May 12 14:23:43.117616 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 2/5] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 12 14:23:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:23:43.332396 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-4f6b09bf-f66e-4020-843d-3f7ccc605394 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:23:43.334843 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:23:43.334843 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: warnings.warn(msg) May 12 14:23:43.382996 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-4f6b09bf-f66e-4020-843d-3f7ccc605394 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.257197 May 12 14:23:43.389166 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 4/6] 10.222.0.75 () {64 vars in 1335 bytes} [Thu May 12 14:23:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:23:45.695869 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-ac4a5934-175b-46a3-b57c-bb2897e37cd6 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:23:45.696883 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-ac4a5934-175b-46a3-b57c-bb2897e37cd6 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 12 14:23:45.697283 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 3/7] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 12 14:23:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:23:45.820329 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-0fb7fe32-91ba-4368-8888-3a616a1bf827 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "id": "d1"}} {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:23:45.838442 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:23:45.838442 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: warnings.warn(msg) May 12 14:23:45.857095 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-0fb7fe32-91ba-4368-8888-3a616a1bf827 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153379 May 12 14:23:45.857653 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 5/8] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 12 14:23:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:23:45.869265 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-04f29271-b635-4ae7-aba9-846bd2aca6c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:23:45.870802 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:23:45.870802 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: warnings.warn(msg) May 12 14:23:45.902602 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-04f29271-b635-4ae7-aba9-846bd2aca6c6 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036851 May 12 14:23:45.903339 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 4/9] 10.222.0.75 () {64 vars in 1335 bytes} [Thu May 12 14:23:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:23:48.178049 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-0fb7fe32-91ba-4368-8888-3a616a1bf827 admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:23:48.179140 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-0fb7fe32-91ba-4368-8888-3a616a1bf827 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 12 14:23:48.179701 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 6/10] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 12 14:23:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:23:48.237011 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-4f5fce1e-c726-40b6-83d2-309078ac584e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:23:48.256379 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-4f5fce1e-c726-40b6-83d2-309078ac584e admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071079 May 12 14:23:48.257196 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 5/11] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 12 14:23:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:23:48.270473 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-972b5f08-320c-4260-9e21-0c7a5f444efb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:23:48.298505 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-972b5f08-320c-4260-9e21-0c7a5f444efb admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032184 May 12 14:23:48.299679 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 7/12] 10.222.0.75 () {64 vars in 1335 bytes} [Thu May 12 14:23:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:23:50.610239 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-4f5fce1e-c726-40b6-83d2-309078ac584e admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:23:50.611193 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-4f5fce1e-c726-40b6-83d2-309078ac584e admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 12 14:23:50.611617 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 6/13] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 12 14:23:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:23:50.673664 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-10060c42-d5a4-48b2-97bf-9fbf7fe2a3c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3", "os-flavor-access:is_public": true, "swap": 0, "ram": 2048}} {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:23:50.693121 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-10060c42-d5a4-48b2-97bf-9fbf7fe2a3c3 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075415 May 12 14:23:50.693681 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 8/14] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 12 14:23:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:23:50.705940 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-72c66ed5-b477-4fb6-bc2d-8f8b7cffd657 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:23:50.732114 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-72c66ed5-b477-4fb6-bc2d-8f8b7cffd657 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029702 May 12 14:23:50.732700 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 7/15] 10.222.0.75 () {64 vars in 1335 bytes} [Thu May 12 14:23:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:23:53.027634 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-10060c42-d5a4-48b2-97bf-9fbf7fe2a3c3 admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:23:53.028882 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-10060c42-d5a4-48b2-97bf-9fbf7fe2a3c3 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 May 12 14:23:53.029328 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 9/16] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 12 14:23:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:23:53.087719 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-dea1cd6b-151c-4434-a3bd-c47beb163b87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:23:53.106102 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-dea1cd6b-151c-4434-a3bd-c47beb163b87 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071131 May 12 14:23:53.107126 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 8/17] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 12 14:23:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:23:53.118790 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-be1c083a-6495-428a-9fbc-8edf460c07a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:23:53.145843 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-be1c083a-6495-428a-9fbc-8edf460c07a2 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030826 May 12 14:23:53.146743 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 10/18] 10.222.0.75 () {64 vars in 1335 bytes} [Thu May 12 14:23:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:23:55.444796 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-dea1cd6b-151c-4434-a3bd-c47beb163b87 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:23:55.445808 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-dea1cd6b-151c-4434-a3bd-c47beb163b87 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 12 14:23:55.446485 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 9/19] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 12 14:23:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:23:55.521534 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-bebf1862-90c2-4710-afb0-1ec4dafa6ea3 admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:23:55.549150 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-bebf1862-90c2-4710-afb0-1ec4dafa6ea3 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.095723 May 12 14:23:55.549714 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 11/20] 10.222.0.75 () {60 vars in 1291 bytes} [Thu May 12 14:23:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:23:58.080057 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-dea1cd6b-151c-4434-a3bd-c47beb163b87 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:23:58.081306 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-dea1cd6b-151c-4434-a3bd-c47beb163b87 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001767 May 12 14:23:58.081760 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 10/21] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 12 14:23:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:23:58.149974 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-c2c9552d-68c7-4f10-8d44-4ad57d4843fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "id": "1", "swap": 0, "vcpus": 1, "ram": 512}} {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:23:58.177714 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-c2c9552d-68c7-4f10-8d44-4ad57d4843fd admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.088231 May 12 14:23:58.178731 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 12/22] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 12 14:23:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:23:58.192564 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-ec894c0b-20c3-4c07-b15d-69bcdef2c400 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:23:58.219383 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-ec894c0b-20c3-4c07-b15d-69bcdef2c400 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031440 May 12 14:23:58.219849 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 11/23] 10.222.0.75 () {64 vars in 1332 bytes} [Thu May 12 14:23:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:24:00.926402 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-c2c9552d-68c7-4f10-8d44-4ad57d4843fd admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:00.927782 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-c2c9552d-68c7-4f10-8d44-4ad57d4843fd admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 May 12 14:24:00.928338 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 13/24] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 12 14:24:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:24:00.989404 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-ab8d867f-c3e8-40ea-b398-1a0a9f3ba4aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:24:01.007311 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-ab8d867f-c3e8-40ea-b398-1a0a9f3ba4aa admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071760 May 12 14:24:01.007895 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 12/25] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 12 14:24:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:24:01.023399 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-d1669cae-b93d-4106-9242-37e5a503866c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:24:01.050288 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-d1669cae-b93d-4106-9242-37e5a503866c admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031493 May 12 14:24:01.055139 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 14/26] 10.222.0.75 () {64 vars in 1332 bytes} [Thu May 12 14:24:01 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:24:03.681965 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-ab8d867f-c3e8-40ea-b398-1a0a9f3ba4aa admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:03.683108 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-ab8d867f-c3e8-40ea-b398-1a0a9f3ba4aa admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 May 12 14:24:03.683598 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 13/27] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 12 14:24:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:24:03.741944 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-e14e3f48-b7cd-40f1-9513-692a77ad57fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "name": "m1.medium", "ram": 4096, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:24:03.760830 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-e14e3f48-b7cd-40f1-9513-692a77ad57fc admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070739 May 12 14:24:03.761385 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 15/28] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 12 14:24:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:24:03.773784 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-d9f097eb-ff67-4ee2-9e1f-1820a3938b60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:24:03.797085 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-d9f097eb-ff67-4ee2-9e1f-1820a3938b60 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026935 May 12 14:24:03.797718 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 14/29] 10.222.0.75 () {64 vars in 1332 bytes} [Thu May 12 14:24:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:24:06.103451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-e14e3f48-b7cd-40f1-9513-692a77ad57fc admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:06.104500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-e14e3f48-b7cd-40f1-9513-692a77ad57fc admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 12 14:24:06.104901 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 16/30] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 12 14:24:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:24:06.167681 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-e24907ed-193e-48e2-b65d-19ced500a6a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:24:06.187648 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-e24907ed-193e-48e2-b65d-19ced500a6a7 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076933 May 12 14:24:06.188467 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 15/31] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 12 14:24:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:24:06.200369 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-aaee86fb-c28b-4cdd-a5cc-a8e42300f42c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:24:06.225402 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-aaee86fb-c28b-4cdd-a5cc-a8e42300f42c admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028869 May 12 14:24:06.225977 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 17/32] 10.222.0.75 () {64 vars in 1332 bytes} [Thu May 12 14:24:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:24:08.507873 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-e24907ed-193e-48e2-b65d-19ced500a6a7 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:08.508889 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-e24907ed-193e-48e2-b65d-19ced500a6a7 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 12 14:24:08.509303 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 16/33] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 12 14:24:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:24:08.571636 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-15b9b715-48a2-4eae-a5fa-b7909d1c40fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 8, "disk": 160}} {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:24:08.589596 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-15b9b715-48a2-4eae-a5fa-b7909d1c40fe admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074332 May 12 14:24:08.590449 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 18/34] 10.222.0.75 () {64 vars in 1282 bytes} [Thu May 12 14:24:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:24:08.602083 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-3d053f3a-575e-4ffa-93e3-88ac9cd3bee3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:24:08.625531 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-3d053f3a-575e-4ffa-93e3-88ac9cd3bee3 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026905 May 12 14:24:08.626310 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 17/35] 10.222.0.75 () {64 vars in 1332 bytes} [Thu May 12 14:24:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:24:32.574171 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-15b9b715-48a2-4eae-a5fa-b7909d1c40fe admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:32.575249 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-15b9b715-48a2-4eae-a5fa-b7909d1c40fe admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 12 14:24:32.575645 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 19/36] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 12 14:24:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:24:32.632252 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-de31f933-2c0e-4011-ade2-71a693a27bab admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:32.650133 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-de31f933-2c0e-4011-ade2-71a693a27bab admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068448 May 12 14:24:32.650667 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 18/37] 10.222.0.75 () {60 vars in 1291 bytes} [Thu May 12 14:24:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:24:33.668987 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-15b9b715-48a2-4eae-a5fa-b7909d1c40fe admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:33.669977 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-15b9b715-48a2-4eae-a5fa-b7909d1c40fe admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 May 12 14:24:33.670391 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 20/38] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 12 14:24:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:24:33.860547 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-12f4b059-02f4-43b7-a54c-986526bbcb2e admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:33.866171 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.wsgi [None req-12f4b059-02f4-43b7-a54c-986526bbcb2e admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-12f4b059-02f4-43b7-a54c-986526bbcb2e admin admin] Request method failure captured: May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Accept: application/json May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Accept-Encoding: gzip, deflate May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Connection: keep-alive May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Content-Length: 0 May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Host: 10.222.0.75 May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Openstack-Api-Version: compute 2.90 May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Openstack-System-Scope: None May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: User-Agent: python-novaclient May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Auth-Token: gAAAAABifRihiaAFb57zFOqQkWqcp5yRIfkZ1YsOqPX160BYFnyzCQzz79B5f-QhIOdx1MzKegYhCEfkOWEjBl4w9N3Bz0mqNhf9aVvLP6IksvUQrGo5TgFYw8-DFVRKuBk3aqxUs9Uq3z_exZr-FZJJmxh1IHLAXRADB57xO5Eu0lkh6rM4fto May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Domain-Id: None May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Domain-Name: None May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Identity-Status: Confirmed May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Is-Admin-Project: True May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Openstack-Nova-Api-Version: 2.90 May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Project-Domain-Id: default May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Project-Domain-Name: Default May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Project-Id: b51fa73b4d054aee9ce299da7ce9ee7a May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Project-Name: admin May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Role: admin,reader,member May 12 14:24:33.869489 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Roles: admin,reader,member May 12 14:24:33.871220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b51fa73b4d054aee9ce299da7ce9ee7a", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:24:33.871220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Tenant: admin May 12 14:24:33.871220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Tenant-Id: b51fa73b4d054aee9ce299da7ce9ee7a May 12 14:24:33.871220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Tenant-Name: admin May 12 14:24:33.871220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-User: admin May 12 14:24:33.871220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-User-Domain-Id: default May 12 14:24:33.871220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-User-Domain-Name: Default May 12 14:24:33.871220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-User-Id: 7c5460943950426d8cc84743272b5303 May 12 14:24:33.871220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-User-Name: admin May 12 14:24:33.871220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: method: > May 12 14:24:33.871220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: exception: Flavor 42 could not be found. May 12 14:24:33.871220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: action_args: {'id': '42'} May 12 14:24:33.871220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:24:33.871220 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:24:33.872155 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi May 12 14:24:33.874358 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-12f4b059-02f4-43b7-a54c-986526bbcb2e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:24:33.875664 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-12f4b059-02f4-43b7-a54c-986526bbcb2e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062444 May 12 14:24:33.875664 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 19/39] 10.222.0.75 () {60 vars in 1190 bytes} [Thu May 12 14:24:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:24:33.881355 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-3174f684-eeea-46b3-9fc8-9c31656efd8d admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:33.902044 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-3174f684-eeea-46b3-9fc8-9c31656efd8d admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024271 May 12 14:24:33.902595 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 21/40] 10.222.0.75 () {60 vars in 1210 bytes} [Thu May 12 14:24:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:24:33.912400 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-c1d1fa50-941d-47c3-ab71-fc49c8208df1 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:33.933827 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-c1d1fa50-941d-47c3-ab71-fc49c8208df1 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024984 May 12 14:24:33.934384 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 20/41] 10.222.0.75 () {60 vars in 1210 bytes} [Thu May 12 14:24:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:24:33.944764 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-55fc253a-c389-47a2-b814-b1d84c5f1577 admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:33.950662 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.wsgi [None req-55fc253a-c389-47a2-b814-b1d84c5f1577 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-55fc253a-c389-47a2-b814-b1d84c5f1577 admin admin] Request method failure captured: May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Accept: application/json May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Accept-Encoding: gzip, deflate May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Connection: keep-alive May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Content-Length: 0 May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Host: 10.222.0.75 May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Openstack-Api-Version: compute 2.90 May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Openstack-System-Scope: None May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: User-Agent: python-novaclient May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Auth-Token: gAAAAABifRihiaAFb57zFOqQkWqcp5yRIfkZ1YsOqPX160BYFnyzCQzz79B5f-QhIOdx1MzKegYhCEfkOWEjBl4w9N3Bz0mqNhf9aVvLP6IksvUQrGo5TgFYw8-DFVRKuBk3aqxUs9Uq3z_exZr-FZJJmxh1IHLAXRADB57xO5Eu0lkh6rM4fto May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Domain-Id: None May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Domain-Name: None May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Identity-Status: Confirmed May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Is-Admin-Project: True May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Openstack-Nova-Api-Version: 2.90 May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Project-Domain-Id: default May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Project-Domain-Name: Default May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Project-Id: b51fa73b4d054aee9ce299da7ce9ee7a May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Project-Name: admin May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Role: admin,reader,member May 12 14:24:33.954145 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Roles: admin,reader,member May 12 14:24:33.956710 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b51fa73b4d054aee9ce299da7ce9ee7a", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:24:33.956710 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Tenant: admin May 12 14:24:33.956710 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Tenant-Id: b51fa73b4d054aee9ce299da7ce9ee7a May 12 14:24:33.956710 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Tenant-Name: admin May 12 14:24:33.956710 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-User: admin May 12 14:24:33.956710 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-User-Domain-Id: default May 12 14:24:33.956710 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-User-Domain-Name: Default May 12 14:24:33.956710 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-User-Id: 7c5460943950426d8cc84743272b5303 May 12 14:24:33.956710 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-User-Name: admin May 12 14:24:33.956710 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: method: > May 12 14:24:33.956710 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: exception: Flavor 42 could not be found. May 12 14:24:33.956710 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: action_args: {'id': '42'} May 12 14:24:33.956710 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:24:33.956710 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:24:33.958093 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi May 12 14:24:33.959930 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-55fc253a-c389-47a2-b814-b1d84c5f1577 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:24:33.961684 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-55fc253a-c389-47a2-b814-b1d84c5f1577 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014417 May 12 14:24:33.961684 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 22/42] 10.222.0.75 () {60 vars in 1190 bytes} [Thu May 12 14:24:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:24:34.847380 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-c1d1fa50-941d-47c3-ab71-fc49c8208df1 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:34.848392 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-c1d1fa50-941d-47c3-ab71-fc49c8208df1 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 12 14:24:34.848796 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 21/43] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 12 14:24:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:24:35.041276 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-77ba2581-b2ae-4149-adb0-bcb761fe457c admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:35.046980 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.wsgi [None req-77ba2581-b2ae-4149-adb0-bcb761fe457c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-77ba2581-b2ae-4149-adb0-bcb761fe457c admin admin] Request method failure captured: May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Accept: application/json May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Accept-Encoding: gzip, deflate May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Connection: keep-alive May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Content-Length: 0 May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Host: 10.222.0.75 May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Openstack-Api-Version: compute 2.90 May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Openstack-System-Scope: None May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: User-Agent: python-novaclient May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Auth-Token: gAAAAABifRiiwHW_T1BW32i2cGeQDV0v_g6AUtvtEOq6SuV0j56sXAXc95LITmbmejnSLqdx1lqMZBDU1ojRfDK6zGlKuPjOm6IDDL5h0GYf4YAxmAJ83vN8H2NXXwJ5M62UHWKtJ9bjmz-uFtqg5c9ZBGmeTQRPxRffwTHbaBSTp_rrP1gfEj0 May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Domain-Id: None May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Domain-Name: None May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Identity-Status: Confirmed May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Is-Admin-Project: True May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Openstack-Nova-Api-Version: 2.90 May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Project-Domain-Id: default May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Project-Domain-Name: Default May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Project-Id: b51fa73b4d054aee9ce299da7ce9ee7a May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Project-Name: admin May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Role: admin,reader,member May 12 14:24:35.048506 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Roles: admin,reader,member May 12 14:24:35.050036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b51fa73b4d054aee9ce299da7ce9ee7a", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:24:35.050036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Tenant: admin May 12 14:24:35.050036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Tenant-Id: b51fa73b4d054aee9ce299da7ce9ee7a May 12 14:24:35.050036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Tenant-Name: admin May 12 14:24:35.050036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-User: admin May 12 14:24:35.050036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-User-Domain-Id: default May 12 14:24:35.050036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-User-Domain-Name: Default May 12 14:24:35.050036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-User-Id: 7c5460943950426d8cc84743272b5303 May 12 14:24:35.050036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-User-Name: admin May 12 14:24:35.050036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: method: > May 12 14:24:35.050036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: exception: Flavor 84 could not be found. May 12 14:24:35.050036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: action_args: {'id': '84'} May 12 14:24:35.050036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:24:35.050036 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:24:35.051135 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi May 12 14:24:35.052500 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-77ba2581-b2ae-4149-adb0-bcb761fe457c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:24:35.053755 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-77ba2581-b2ae-4149-adb0-bcb761fe457c admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.066191 May 12 14:24:35.053755 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 23/44] 10.222.0.75 () {60 vars in 1190 bytes} [Thu May 12 14:24:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:24:35.060289 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-caf55325-f9a3-4d67-a666-d89f0946a39d admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:35.074121 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-caf55325-f9a3-4d67-a666-d89f0946a39d admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017425 May 12 14:24:35.074693 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 22/45] 10.222.0.75 () {60 vars in 1210 bytes} [Thu May 12 14:24:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:24:35.086163 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-282ad3c5-e214-4b76-9537-7af76027bb50 admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:35.100214 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-282ad3c5-e214-4b76-9537-7af76027bb50 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017879 May 12 14:24:35.100786 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 24/46] 10.222.0.75 () {60 vars in 1210 bytes} [Thu May 12 14:24:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:24:35.110444 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-f81cc0da-3aa4-4c7c-8390-05f3cd3bdba9 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:35.115837 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.wsgi [None req-f81cc0da-3aa4-4c7c-8390-05f3cd3bdba9 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-f81cc0da-3aa4-4c7c-8390-05f3cd3bdba9 admin admin] Request method failure captured: May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Accept: application/json May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Accept-Encoding: gzip, deflate May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Connection: keep-alive May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Content-Length: 0 May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Host: 10.222.0.75 May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Openstack-Api-Version: compute 2.90 May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Openstack-System-Scope: None May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: User-Agent: python-novaclient May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Auth-Token: gAAAAABifRiiwHW_T1BW32i2cGeQDV0v_g6AUtvtEOq6SuV0j56sXAXc95LITmbmejnSLqdx1lqMZBDU1ojRfDK6zGlKuPjOm6IDDL5h0GYf4YAxmAJ83vN8H2NXXwJ5M62UHWKtJ9bjmz-uFtqg5c9ZBGmeTQRPxRffwTHbaBSTp_rrP1gfEj0 May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Domain-Id: None May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Domain-Name: None May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Identity-Status: Confirmed May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Is-Admin-Project: True May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Openstack-Nova-Api-Version: 2.90 May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Project-Domain-Id: default May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Project-Domain-Name: Default May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Project-Id: b51fa73b4d054aee9ce299da7ce9ee7a May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Project-Name: admin May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Role: admin,reader,member May 12 14:24:35.117348 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Roles: admin,reader,member May 12 14:24:35.118872 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b51fa73b4d054aee9ce299da7ce9ee7a", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:24:35.118872 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Tenant: admin May 12 14:24:35.118872 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Tenant-Id: b51fa73b4d054aee9ce299da7ce9ee7a May 12 14:24:35.118872 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Tenant-Name: admin May 12 14:24:35.118872 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-User: admin May 12 14:24:35.118872 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-User-Domain-Id: default May 12 14:24:35.118872 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-User-Domain-Name: Default May 12 14:24:35.118872 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-User-Id: 7c5460943950426d8cc84743272b5303 May 12 14:24:35.118872 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-User-Name: admin May 12 14:24:35.118872 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: method: > May 12 14:24:35.118872 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: exception: Flavor 84 could not be found. May 12 14:24:35.118872 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: action_args: {'id': '84'} May 12 14:24:35.118872 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:24:35.118872 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:24:35.119876 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi May 12 14:24:35.121112 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-f81cc0da-3aa4-4c7c-8390-05f3cd3bdba9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:24:35.122359 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-f81cc0da-3aa4-4c7c-8390-05f3cd3bdba9 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012002 May 12 14:24:35.122359 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 23/47] 10.222.0.75 () {60 vars in 1190 bytes} [Thu May 12 14:24:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:24:36.015838 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-282ad3c5-e214-4b76-9537-7af76027bb50 admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:36.016851 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-282ad3c5-e214-4b76-9537-7af76027bb50 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 12 14:24:36.017253 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 25/48] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 12 14:24:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:24:36.225844 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-fd598c67-18ad-41a7-b736-f2318657f88e admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:36.231798 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.wsgi [None req-fd598c67-18ad-41a7-b736-f2318657f88e admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-fd598c67-18ad-41a7-b736-f2318657f88e admin admin] Request method failure captured: May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Accept: application/json May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Accept-Encoding: gzip, deflate May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Connection: keep-alive May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Content-Length: 0 May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Host: 10.222.0.75 May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Openstack-Api-Version: compute 2.90 May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Openstack-System-Scope: None May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: User-Agent: python-novaclient May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Auth-Token: gAAAAABifRikcXFuC72Sw6Y-JtRvHX6aZYYXNjL7CCYYjQ_NcMuN-ko1UG4jiSEAMTKW-jcVHYG7Y2f0aCERQ7W9TKOXpU5tfxWty9JQDvWs2dEmMFHuQunOPysR6B2_6aN-RKJDI-r_jwJa2kbR96aUcgY1HDZWFRuKRwc5Ek066d0cLrPp8jE May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Domain-Id: None May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Domain-Name: None May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Identity-Status: Confirmed May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Is-Admin-Project: True May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Openstack-Nova-Api-Version: 2.90 May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Project-Domain-Id: default May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Project-Domain-Name: Default May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Project-Id: b51fa73b4d054aee9ce299da7ce9ee7a May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Project-Name: admin May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Role: admin,reader,member May 12 14:24:36.233297 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Roles: admin,reader,member May 12 14:24:36.234887 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b51fa73b4d054aee9ce299da7ce9ee7a", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:24:36.234887 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Tenant: admin May 12 14:24:36.234887 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Tenant-Id: b51fa73b4d054aee9ce299da7ce9ee7a May 12 14:24:36.234887 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-Tenant-Name: admin May 12 14:24:36.234887 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-User: admin May 12 14:24:36.234887 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-User-Domain-Id: default May 12 14:24:36.234887 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-User-Domain-Name: Default May 12 14:24:36.234887 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-User-Id: 7c5460943950426d8cc84743272b5303 May 12 14:24:36.234887 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: X-User-Name: admin May 12 14:24:36.234887 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: method: > May 12 14:24:36.234887 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: exception: Flavor 451 could not be found. May 12 14:24:36.234887 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: action_args: {'id': '451'} May 12 14:24:36.234887 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:24:36.234887 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:24:36.235905 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: ERROR nova.api.openstack.wsgi May 12 14:24:36.237355 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-fd598c67-18ad-41a7-b736-f2318657f88e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:24:36.238574 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-fd598c67-18ad-41a7-b736-f2318657f88e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.072357 May 12 14:24:36.238574 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 24/49] 10.222.0.75 () {60 vars in 1193 bytes} [Thu May 12 14:24:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:24:36.244740 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-d0cd7d80-e6d8-40e4-95f5-737ef59d2bd5 admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:36.262796 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-d0cd7d80-e6d8-40e4-95f5-737ef59d2bd5 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021564 May 12 14:24:36.263534 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 26/50] 10.222.0.75 () {60 vars in 1210 bytes} [Thu May 12 14:24:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:24:36.274525 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-fe295d9f-3788-4959-bf72-a6be56e46160 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:36.288816 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-fe295d9f-3788-4959-bf72-a6be56e46160 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017789 May 12 14:24:36.289357 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 25/51] 10.222.0.75 () {60 vars in 1210 bytes} [Thu May 12 14:24:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:24:36.298655 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-551e9288-3156-461b-bbbe-2cc19c89bb1f admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:36.303955 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.wsgi [None req-551e9288-3156-461b-bbbe-2cc19c89bb1f admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-551e9288-3156-461b-bbbe-2cc19c89bb1f admin admin] Request method failure captured: May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Accept: application/json May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Accept-Encoding: gzip, deflate May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Connection: keep-alive May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Content-Length: 0 May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Host: 10.222.0.75 May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Openstack-Api-Version: compute 2.90 May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Openstack-System-Scope: None May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: User-Agent: python-novaclient May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Auth-Token: gAAAAABifRikcXFuC72Sw6Y-JtRvHX6aZYYXNjL7CCYYjQ_NcMuN-ko1UG4jiSEAMTKW-jcVHYG7Y2f0aCERQ7W9TKOXpU5tfxWty9JQDvWs2dEmMFHuQunOPysR6B2_6aN-RKJDI-r_jwJa2kbR96aUcgY1HDZWFRuKRwc5Ek066d0cLrPp8jE May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Domain-Id: None May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Domain-Name: None May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Identity-Status: Confirmed May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Is-Admin-Project: True May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Openstack-Nova-Api-Version: 2.90 May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Project-Domain-Id: default May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Project-Domain-Name: Default May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Project-Id: b51fa73b4d054aee9ce299da7ce9ee7a May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Project-Name: admin May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Role: admin,reader,member May 12 14:24:36.305451 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Roles: admin,reader,member May 12 14:24:36.306992 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b51fa73b4d054aee9ce299da7ce9ee7a", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b51fa73b4d054aee9ce299da7ce9ee7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:24:36.306992 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Tenant: admin May 12 14:24:36.306992 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Tenant-Id: b51fa73b4d054aee9ce299da7ce9ee7a May 12 14:24:36.306992 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-Tenant-Name: admin May 12 14:24:36.306992 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-User: admin May 12 14:24:36.306992 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-User-Domain-Id: default May 12 14:24:36.306992 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-User-Domain-Name: Default May 12 14:24:36.306992 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-User-Id: 7c5460943950426d8cc84743272b5303 May 12 14:24:36.306992 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: X-User-Name: admin May 12 14:24:36.306992 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: method: > May 12 14:24:36.306992 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: exception: Flavor 451 could not be found. May 12 14:24:36.306992 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: action_args: {'id': '451'} May 12 14:24:36.306992 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:24:36.306992 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:24:36.308087 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: ERROR nova.api.openstack.wsgi May 12 14:24:36.309420 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-551e9288-3156-461b-bbbe-2cc19c89bb1f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:24:36.310678 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-551e9288-3156-461b-bbbe-2cc19c89bb1f admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011819 May 12 14:24:36.310678 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 27/52] 10.222.0.75 () {60 vars in 1193 bytes} [Thu May 12 14:24:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:24:37.225063 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-fe295d9f-3788-4959-bf72-a6be56e46160 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:37.226066 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-fe295d9f-3788-4959-bf72-a6be56e46160 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 12 14:24:37.226599 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 26/53] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 12 14:24:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:24:37.417410 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-685d5d21-599e-4a19-9482-e2951c922a9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:24:37.444035 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-685d5d21-599e-4a19-9482-e2951c922a9d admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.081371 May 12 14:24:37.444860 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 28/54] 10.222.0.75 () {64 vars in 1235 bytes} [Thu May 12 14:24:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:24:38.345621 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-fe295d9f-3788-4959-bf72-a6be56e46160 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:38.346642 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-fe295d9f-3788-4959-bf72-a6be56e46160 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001752 May 12 14:24:38.347136 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 27/55] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 12 14:24:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:24:38.539775 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-babf5f8a-21df-4315-9935-ec623631eb6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:24:38.563868 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-babf5f8a-21df-4315-9935-ec623631eb6f admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.076399 May 12 14:24:38.564348 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 29/56] 10.222.0.75 () {64 vars in 1235 bytes} [Thu May 12 14:24:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:24:39.469996 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-fe295d9f-3788-4959-bf72-a6be56e46160 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:39.471001 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-fe295d9f-3788-4959-bf72-a6be56e46160 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 12 14:24:39.471429 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 28/57] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 12 14:24:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:24:39.667326 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-0c17564b-79d2-4cc6-be6e-d0dda94ff1e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:24:39.685058 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-0c17564b-79d2-4cc6-be6e-d0dda94ff1e7 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.077649 May 12 14:24:39.686251 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 30/58] 10.222.0.75 () {64 vars in 1235 bytes} [Thu May 12 14:24:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:24:40.608398 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-fe295d9f-3788-4959-bf72-a6be56e46160 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:40.609414 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-fe295d9f-3788-4959-bf72-a6be56e46160 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001979 May 12 14:24:40.610176 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 29/59] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 12 14:24:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:24:40.797874 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-46730ee4-f197-4c33-af6e-c3ed9a455935 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:24:40.817842 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-46730ee4-f197-4c33-af6e-c3ed9a455935 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.072840 May 12 14:24:40.818453 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 31/60] 10.222.0.75 () {64 vars in 1235 bytes} [Thu May 12 14:24:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:24:41.719808 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-fe295d9f-3788-4959-bf72-a6be56e46160 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:41.720821 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-fe295d9f-3788-4959-bf72-a6be56e46160 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 May 12 14:24:41.721221 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 30/61] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 12 14:24:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:24:41.912370 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-3869a53d-f394-45b6-8cab-dd77304c1978 admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:24:41.931306 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-3869a53d-f394-45b6-8cab-dd77304c1978 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076622 May 12 14:24:41.931842 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 32/62] 10.222.0.75 () {60 vars in 1202 bytes} [Thu May 12 14:24:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:25:44.852450 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-fe295d9f-3788-4959-bf72-a6be56e46160 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:25:44.853464 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-fe295d9f-3788-4959-bf72-a6be56e46160 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 12 14:25:44.853871 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 31/63] 10.222.0.75 () {54 vars in 930 bytes} [Thu May 12 14:25:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:25:44.913341 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-43c12d0f-1efd-4c47-bcd3-7d62494d3c69 admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:25:44.932116 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-43c12d0f-1efd-4c47-bcd3-7d62494d3c69 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071780 May 12 14:25:44.932661 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 33/64] 10.222.0.75 () {60 vars in 1291 bytes} [Thu May 12 14:25:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:25:44.956043 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-94f27db7-6f24-40c8-bd1f-8343b6666b8d admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:25:44.963813 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-94f27db7-6f24-40c8-bd1f-8343b6666b8d admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012070 May 12 14:25:44.964357 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 32/65] 10.222.0.75 () {60 vars in 1282 bytes} [Thu May 12 14:25:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:25:44.975836 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-e3af88a9-df12-47f6-9745-cb9cc94c2a2a admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:25:44.983914 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-e3af88a9-df12-47f6-9745-cb9cc94c2a2a admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011750 May 12 14:25:44.984428 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 34/66] 10.222.0.75 () {60 vars in 1285 bytes} [Thu May 12 14:25:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:25:44.995481 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-2724bf05-11eb-4f0d-a1aa-ab2fe4855d43 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:25:45.003564 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-2724bf05-11eb-4f0d-a1aa-ab2fe4855d43 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011600 May 12 14:25:45.004076 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 33/67] 10.222.0.75 () {60 vars in 1285 bytes} [Thu May 12 14:25:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:25:45.016251 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-6afc29bf-e4d1-47cb-b011-42934b83d32c admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:25:45.023802 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-6afc29bf-e4d1-47cb-b011-42934b83d32c admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012247 May 12 14:25:45.024359 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 35/68] 10.222.0.75 () {60 vars in 1282 bytes} [Thu May 12 14:25:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:29:09.366507 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-2724bf05-11eb-4f0d-a1aa-ab2fe4855d43 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:29:09.368113 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-2724bf05-11eb-4f0d-a1aa-ab2fe4855d43 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002379 May 12 14:29:09.368533 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 34/69] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 12 14:29:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:29:09.639951 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-7be251ff-64b3-40ad-a49d-0f21466bbfae admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:29:09.641164 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:29:09.641164 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: warnings.warn(msg) May 12 14:29:09.642386 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-7be251ff-64b3-40ad-a49d-0f21466bbfae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:29:09.642827 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-7be251ff-64b3-40ad-a49d-0f21466bbfae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:29:09.643658 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-7be251ff-64b3-40ad-a49d-0f21466bbfae admin admin] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:29:09.644095 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-7be251ff-64b3-40ad-a49d-0f21466bbfae admin admin] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:29:09.677755 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-7be251ff-64b3-40ad-a49d-0f21466bbfae admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.152613 May 12 14:29:09.678318 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 36/70] 10.222.0.75 () {60 vars in 1193 bytes} [Thu May 12 14:29:09 2022] GET /compute/v2.1/os-services => generated 794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:29:10.583132 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-2724bf05-11eb-4f0d-a1aa-ab2fe4855d43 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:29:10.584289 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-2724bf05-11eb-4f0d-a1aa-ab2fe4855d43 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 12 14:29:10.584684 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 35/71] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 12 14:29:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:29:10.777728 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-44369288-cff2-42e2-9ae8-1bc3080e2de9 admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:29:10.778909 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:29:10.778909 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: warnings.warn(msg) May 12 14:29:10.780159 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-44369288-cff2-42e2-9ae8-1bc3080e2de9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:29:10.780599 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-44369288-cff2-42e2-9ae8-1bc3080e2de9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:29:10.781415 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-44369288-cff2-42e2-9ae8-1bc3080e2de9 admin admin] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:29:10.781845 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-44369288-cff2-42e2-9ae8-1bc3080e2de9 admin admin] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:29:10.801107 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-44369288-cff2-42e2-9ae8-1bc3080e2de9 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.073699 May 12 14:29:10.801597 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 37/72] 10.222.0.75 () {60 vars in 1193 bytes} [Thu May 12 14:29:10 2022] GET /compute/v2.1/os-services => generated 794 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:29:22.254030 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-2724bf05-11eb-4f0d-a1aa-ab2fe4855d43 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:29:22.256402 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-2724bf05-11eb-4f0d-a1aa-ab2fe4855d43 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002378 May 12 14:29:22.256831 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 36/73] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 12 14:29:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:29:22.465058 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-eeea1860-671c-4e3c-93ca-9165a20d3509 admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:29:22.466235 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:29:22.466235 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: warnings.warn(msg) May 12 14:29:22.467460 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-eeea1860-671c-4e3c-93ca-9165a20d3509 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:29:22.467911 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-eeea1860-671c-4e3c-93ca-9165a20d3509 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:29:22.468705 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-eeea1860-671c-4e3c-93ca-9165a20d3509 admin admin] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:29:22.469187 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-eeea1860-671c-4e3c-93ca-9165a20d3509 admin admin] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:29:22.495797 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-eeea1860-671c-4e3c-93ca-9165a20d3509 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.088655 May 12 14:29:22.496512 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 38/74] 10.222.0.75 () {60 vars in 1193 bytes} [Thu May 12 14:29:22 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:29:23.399257 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: DEBUG nova.api.openstack.wsgi [None req-2724bf05-11eb-4f0d-a1aa-ab2fe4855d43 admin admin] Calling method '>' {{(pid=102653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:29:23.400270 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: INFO nova.api.openstack.requestlog [None req-2724bf05-11eb-4f0d-a1aa-ab2fe4855d43 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 12 14:29:23.400675 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: [pid: 102653|app: 0|req: 37/75] 10.222.0.75 () {56 vars in 1074 bytes} [Thu May 12 14:29:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:29:23.592027 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG nova.api.openstack.wsgi [None req-be84ae98-6860-4b5a-a282-9d5365ff27ea admin admin] Calling method '>' {{(pid=102654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:29:23.593340 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:29:23.593340 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: warnings.warn(msg) May 12 14:29:23.594525 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-be84ae98-6860-4b5a-a282-9d5365ff27ea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:29:23.594970 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-be84ae98-6860-4b5a-a282-9d5365ff27ea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:29:23.595820 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-be84ae98-6860-4b5a-a282-9d5365ff27ea admin admin] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:29:23.596249 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: DEBUG oslo_concurrency.lockutils [None req-be84ae98-6860-4b5a-a282-9d5365ff27ea admin admin] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:29:23.617778 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: INFO nova.api.openstack.requestlog [None req-be84ae98-6860-4b5a-a282-9d5365ff27ea admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.076434 May 12 14:29:23.618251 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: [pid: 102654|app: 0|req: 39/76] 10.222.0.75 () {60 vars in 1193 bytes} [Thu May 12 14:29:23 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:30:25.294230 dv-cinder-777031-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 12 14:30:25.295132 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: Thu May 12 14:30:25 2022 - graceful shutdown triggered... May 12 14:30:25.295635 dv-cinder-777031-14-iscsi devstack@n-api.service[102653]: Gracefully killing worker 1 (pid: 102653)... May 12 14:30:25.296022 dv-cinder-777031-14-iscsi devstack@n-api.service[102654]: Gracefully killing worker 2 (pid: 102654)... May 12 14:30:26.295710 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: worker 1 buried after 1 seconds May 12 14:30:26.295710 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: worker 2 buried after 1 seconds May 12 14:30:26.295710 dv-cinder-777031-14-iscsi devstack@n-api.service[102652]: goodbye to uWSGI. May 12 14:30:26.297155 dv-cinder-777031-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 12 14:30:26.297721 dv-cinder-777031-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 12 14:30:26.300396 dv-cinder-777031-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 14:30:26.314956 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 14:30:26.331676 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 14:30:26 2022] *** May 12 14:30:26.331676 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 14:30:26.331676 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 14:30:26.331676 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: nodename: dv-cinder-777031-14-iscsi May 12 14:30:26.331676 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: machine: x86_64 May 12 14:30:26.331676 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: clock source: unix May 12 14:30:26.331676 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: pcre jit disabled May 12 14:30:26.331676 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: detected number of CPU cores: 4 May 12 14:30:26.331676 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: current working directory: / May 12 14:30:26.331676 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: detected binary path: /usr/bin/uwsgi-core May 12 14:30:26.332464 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: your processes number limit is 47680 May 12 14:30:26.332464 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: your memory page size is 4096 bytes May 12 14:30:26.332464 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: detected max file descriptor number: 2048 May 12 14:30:26.332464 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: lock engine: pthread robust mutexes May 12 14:30:26.332464 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: thunder lock: enabled May 12 14:30:26.332464 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 14:30:26.332464 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 14:30:26.379077 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: Python main interpreter initialized at 0x561232e7c9c0 May 12 14:30:26.379077 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: python threads support enabled May 12 14:30:26.379077 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: your server socket listen backlog is limited to 100 connections May 12 14:30:26.379077 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: your mercy for graceful operations on workers is 90 seconds May 12 14:30:26.379539 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: mapped 403077 bytes (393 KB) for 2 cores May 12 14:30:26.379539 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: *** Operational MODE: preforking *** May 12 14:30:26.379815 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: *** uWSGI is running in multiple interpreter mode *** May 12 14:30:26.379815 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: spawned uWSGI master process (pid: 118196) May 12 14:30:26.380024 dv-cinder-777031-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 14:30:26.380720 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: spawned uWSGI worker 1 (pid: 118216, cores: 1) May 12 14:30:26.383067 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: spawned uWSGI worker 2 (pid: 118217, cores: 1) May 12 14:30:26.383067 dv-cinder-777031-14-iscsi devstack@n-api.service[118196]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 14:30:27.606422 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 14:30:27.630475 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 14:30:28.421531 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:30:28.421531 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: from cryptography.utils import int_from_bytes May 12 14:30:28.422212 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:30:28.422212 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: from cryptography.utils import int_from_bytes May 12 14:30:28.426782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:30:28.426782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: from cryptography.utils import int_from_bytes May 12 14:30:28.427123 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:30:28.427123 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: from cryptography.utils import int_from_bytes May 12 14:30:30.904070 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:30:30.904594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:30:30.904856 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:30:30.905185 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:30:30.905452 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:30:30.905857 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.906195 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.906528 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.906889 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.907929 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.908260 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.908602 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.908938 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.909279 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.909553 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.909914 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.910281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-777031-14-iscsi {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.910656 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.910987 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.911364 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.911697 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.912049 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.912435 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.912677 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.913973 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.916068 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.916068 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.916068 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.916068 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.916068 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.916671 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.916790 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.917231 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.917687 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.918016 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.918877 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-777031-14-iscsi {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.919180 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.919433 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.919750 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:30:30.920190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.920275 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:30:30.920358 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.920438 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:30:30.920517 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.920795 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:30:30.921056 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.921532 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:30:30.921764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.921987 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.922315 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.922535 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.922821 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.923156 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.923401 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.923634 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.923845 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.924033 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.924223 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.924449 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.924449 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.925069 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.925228 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.925379 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.925556 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.925715 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.925867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.926030 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.926181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.926335 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.926517 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-777031-14-iscsi {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.926664 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.926818 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.926818 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.928152 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.928152 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.928455 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.928607 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.929425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.929425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.929753 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.930051 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.930240 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.930395 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.930541 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.930541 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.931528 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.931649 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.931731 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.931818 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.931901 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.931975 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.932054 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.932140 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.932221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.932295 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.932373 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.932452 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.932532 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.932532 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.932688 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.932688 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.932834 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.932913 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.933001 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.933074 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.933150 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.933231 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.933312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-777031-14-iscsi {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.933397 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.933471 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.933542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.933622 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.933695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.933772 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.933863 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.933941 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.934014 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.934090 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.934170 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.934248 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.934332 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.934411 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.934411 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.934552 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.934630 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.934712 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.935190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.935294 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.935381 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.935464 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.935610 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.935734 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.936076 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.936244 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.936399 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.936550 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.936696 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.936863 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.937009 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.937163 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.937326 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.937483 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.937630 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.937786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.937999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.938160 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.938306 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.938466 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.938627 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.938773 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.938920 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.939091 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.939254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.939415 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.939575 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.939575 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.939866 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.940012 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.940158 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.940316 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.940536 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.940696 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.940900 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.941055 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.941213 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.941372 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.941530 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.941687 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.941842 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.941989 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.942134 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.942299 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.942457 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.942610 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.942763 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.942914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.943096 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.943344 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.943500 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.943657 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.944261 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.944983 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.945137 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.945296 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.945443 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.945589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.945589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.945589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.945589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.946207 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.946207 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.946504 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.947976 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.948172 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.948172 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.948478 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.948626 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.948779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.948924 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.949084 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.949231 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.949231 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.949231 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.949231 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.949800 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.949800 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.950091 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.950246 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.950453 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.950725 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.950888 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.951108 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.951261 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.951420 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.951580 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.951745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.951900 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.952053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.952205 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.952351 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.952515 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.952671 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.952816 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.952961 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.953105 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.953257 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.953413 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.953561 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.953749 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.953915 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.954071 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.954330 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.954528 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.954772 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.955350 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.955785 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.955956 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.956119 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.956277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.956431 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.956587 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.956754 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.956907 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.957064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.957219 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.957372 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.957532 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.957677 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.957823 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.957967 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.958111 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.958256 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.958410 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.958566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.958717 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.958870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.959015 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.959205 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.959367 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.959367 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.959752 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.960517 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.960829 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.961140 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.961462 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.961771 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.962079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.962383 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.962688 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.963109 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.963327 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.963632 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.963938 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.964242 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.964566 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.965039 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.965211 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.965517 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.965683 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.965858 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.966125 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.966286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.966442 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.966589 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:30:30.966743 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.966906 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.967097 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.967253 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.967399 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.967552 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.967706 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.967863 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.968018 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.968175 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.968320 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.968474 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.968620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.968778 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.968925 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.969077 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.969225 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.969378 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.969524 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.969693 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.969847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.970003 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.970149 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.970295 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.970440 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.970594 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.970740 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.970885 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.971100 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.971274 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.971436 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.971582 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.971753 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.971949 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.972124 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.972271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.972418 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.972585 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.972740 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.972887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.973032 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.973186 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.973340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.973500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.973647 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.973810 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.973989 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.974155 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.974311 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.974471 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.974652 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.974805 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.974961 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.975150 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.975308 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.975753 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.976539 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.976717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.976873 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.977083 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.977277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.977429 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.977605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.977772 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.977772 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.978112 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.978301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.978453 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.978632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.978791 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.978989 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.979207 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.979207 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.979552 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.979729 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.979928 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.980121 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.980283 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.980481 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.980671 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.980848 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.981029 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.981187 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.981384 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.981573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.981801 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.982930 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.982930 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.984128 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.984303 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.984463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.984463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.984755 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.985008 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.985207 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.985207 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.985537 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.985537 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.985537 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.986162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.986162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.986459 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.987370 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.987540 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.987698 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.987698 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.987698 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.988249 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.988249 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.988578 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.988986 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.989158 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.989316 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.989585 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.989738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.989940 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.990217 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.990371 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.990718 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.991111 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.991315 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.991479 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.991652 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.991831 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.991993 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.992171 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.992344 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.992492 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.992646 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.992797 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.992949 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.993139 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.993317 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.993476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.993629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.993804 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.993958 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.994141 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.994311 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.994459 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.994612 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.994765 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.994919 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.995098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.995266 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.995456 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.995625 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.995771 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.995946 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.996319 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.996476 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.996622 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.996768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.996912 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.997222 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.997388 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.997536 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.997709 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.997867 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.998022 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.998177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.998336 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.998490 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.998636 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.998788 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.998941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.999112 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.999281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.999436 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.999591 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.999757 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:30.999943 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.000107 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.000282 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.000441 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.000596 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.000742 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.000899 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.001209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.001351 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.001507 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.001616 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.001818 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.001918 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.002131 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.002240 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.002433 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.002534 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.002740 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.002836 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.003089 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.003198 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.003639 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.003788 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.003788 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.003965 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.004091 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.004264 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.004418 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.004579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.004733 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.004890 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.005145 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.005303 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.005454 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.005592 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.005743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.005900 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.006047 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.006239 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.006478 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.006645 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.006850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.007013 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.007230 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.007400 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.007558 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.007700 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.007700 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.007972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.008114 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.008205 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.008291 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.008643 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.008886 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.008982 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.009200 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.009303 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.009524 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.009618 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.009837 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.009939 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.010165 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.010260 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.010480 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.010574 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.010805 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.010903 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.011136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.011235 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.011462 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.011566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.011803 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.011906 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.012132 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.012240 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.012450 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.012557 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.012775 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.012878 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.013088 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.013192 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.013404 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.013513 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.013716 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.013817 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.014027 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.014129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.014340 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.014448 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.014654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.014756 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.014972 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.015134 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.015324 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.015432 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.015643 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.015737 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.016002 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.016104 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.016405 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.016640 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.016801 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.017019 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.017253 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.017397 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.017590 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.017781 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.017946 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.018084 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.018217 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.018316 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.018414 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.018645 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.018748 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.018958 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.019083 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.019310 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.019417 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.019634 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.019729 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.020018 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.020112 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.020334 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.020489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.020643 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.020819 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.020951 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.021155 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.021258 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.021566 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.021661 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.021879 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.021972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.022189 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.022295 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.023016 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.023308 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.023461 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.023555 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.023792 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.023940 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.024127 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.024434 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.024763 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.024915 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.025090 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.025290 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.025421 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.025624 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.025746 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.025951 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.026082 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.026315 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.026443 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.026622 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.026744 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.026946 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.027112 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.027282 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.027589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.027841 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.027988 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.028372 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.028529 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.028661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.028791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.028975 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.029221 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.029366 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.029591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.029724 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.029916 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.030176 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.030269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.030537 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.030638 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.030852 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.031144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.031338 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.031480 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.031628 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.031889 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.032064 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.032430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.032583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.032724 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.032878 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.033015 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.033161 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.033299 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.033423 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.033569 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.033708 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.033843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.033989 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.034133 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.034273 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.034431 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.034581 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.034716 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.034852 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.034996 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.035182 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.035341 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.035537 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.035748 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.036137 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.036297 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.036465 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.036757 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.036904 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.037091 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.037293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.037517 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.037709 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.037867 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.038113 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.038830 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.038966 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.039125 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.039272 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.039520 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.039880 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.040028 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.040189 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.040189 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.040478 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.040617 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.040769 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.040912 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.041070 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.041214 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.041358 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.041511 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.041649 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.041803 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.041958 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.042110 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.042246 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.042377 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.042523 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.042794 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.042958 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.043149 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.043296 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.043443 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.043615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.043789 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.043951 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.044046 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.044285 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.044403 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.044605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.044698 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.044919 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.045011 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.045397 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.045489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.045783 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.045898 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.046159 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.046421 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.046527 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.046948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.047142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.047360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.047532 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.047792 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.048103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.048219 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.048476 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.048653 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.048801 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.049127 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.049279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.049431 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.049746 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.049969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.050123 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.050276 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.050429 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.050570 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.050718 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.050858 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.051004 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.051184 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.051328 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.051468 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.051608 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.051748 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.051946 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.052097 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.052269 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.052430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.052570 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.052716 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.052889 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.053033 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.053203 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.053345 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.053522 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.053680 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.053856 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.054206 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.054518 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.054836 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.055176 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.055287 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.055566 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.055874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.056188 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.056271 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.056500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.056593 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.056804 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.057114 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.057410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.057493 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.057727 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.057822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.058040 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.058223 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.058343 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.058594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.058684 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.059072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.059275 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.059580 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.059907 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.060220 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.060527 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.060831 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.060974 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.061141 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.061234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.061444 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.061554 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.061749 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.061842 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.062058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.062186 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.062381 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.062525 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.062697 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.062864 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.063000 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.063230 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.063324 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.063566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.063662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.063918 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.064018 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.064223 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.064315 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.064531 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.064627 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.064833 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.064933 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.065136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.065239 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.065436 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.065537 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.065738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.065840 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.066040 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.066144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.066363 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.066461 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.066673 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.066767 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.066977 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.067113 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.067307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.067402 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.067611 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.067706 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.067961 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.068065 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.068265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.068384 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.068625 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.068719 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.069000 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.069175 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.069814 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.069918 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.070105 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.070246 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.070392 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.070619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.070764 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.071080 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.071193 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.071381 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.071486 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.071700 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.071793 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.072010 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.072103 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.072326 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.072429 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.072631 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.072725 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.072937 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.073030 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.073255 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.073348 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.073564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.073664 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.073876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.073976 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.074197 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.074291 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.074518 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.074611 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.074832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.074924 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.075177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.075288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.075495 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.075596 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.075815 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.075918 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.076125 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.076227 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.076435 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.076534 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.076740 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.076843 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.077052 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.077143 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.077362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.077454 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.077675 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.077846 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.077988 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.078090 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.078302 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.078401 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.078613 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.078719 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.078983 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.079163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.079297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.079417 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.079547 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.079796 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.079897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.080168 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.080267 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.080473 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.080575 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.080783 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.080877 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.081089 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.081193 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.081400 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.081509 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.081705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.081798 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.082044 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.082143 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.082359 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.082462 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.082745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.083077 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.083394 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.083510 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.083705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.083825 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.084020 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.084121 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.084334 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.084443 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.084638 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.084785 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.085156 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.085760 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.085980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.086079 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.086301 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.086435 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.086611 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.086718 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.086918 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.087095 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.087233 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.087446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.087552 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.087769 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.087880 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.088099 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.088205 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.088430 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.088524 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.088738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.088833 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.089102 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.089437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.089541 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.089717 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.089859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.090040 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.090172 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.090366 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.090495 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.090694 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.090824 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.091018 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.091181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.091362 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.091484 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.091684 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.091806 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.092093 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.092344 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.092470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.092652 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.092782 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.092973 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.093114 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.093303 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.093429 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.093735 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.093849 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.093970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.094097 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.094211 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.094332 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.094504 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.094635 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.094874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.095016 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.095181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.095338 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.095469 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.095670 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.095766 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.095989 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.096093 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.096312 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.096407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.096635 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.096774 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.096962 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.097105 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.097291 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.097522 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.097617 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.097847 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.098024 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.098159 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.098346 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.098482 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.098668 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.098813 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.098990 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.099145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.099328 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.099456 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.099642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.099769 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.099965 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.100072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.100298 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.100404 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.100650 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.100759 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.100953 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.101056 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.101263 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.101369 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.101572 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.101675 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.101884 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.101979 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.102190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.102305 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.102494 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.102630 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.102821 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.102952 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.103162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.103294 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.103486 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.103723 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.103828 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.104045 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.104155 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.104363 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.104459 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.104695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.104798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.105021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.105125 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.105331 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.105426 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.105637 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.105778 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.105943 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.106103 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.106247 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.106423 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.106591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.106757 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.106897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.107113 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.107245 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.107438 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.107577 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.107762 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.107908 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.108076 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.108223 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.108408 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.108564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.108739 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.108917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.109061 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.109202 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.109392 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.109521 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.109819 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.109934 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.110141 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.110245 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.110443 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.110538 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.110755 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.110895 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.111077 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.111225 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.111386 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.111544 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.111690 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.111857 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.111998 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.112177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.112379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.112475 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.112687 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.112790 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.112991 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.113096 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.113314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.113408 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.113618 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.113722 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.113941 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.114045 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.114249 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.114358 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.114554 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.114649 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.114858 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.114956 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.115187 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.115299 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.115531 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.115633 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.115835 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.115929 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.116188 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.116296 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.116513 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.116607 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.116835 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.116938 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.117163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.117269 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.117472 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.117566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.117797 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.117893 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.118115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.118221 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.118430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.118535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.118750 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.118850 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.119114 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.119226 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.119397 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.119532 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.119713 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.119818 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.120028 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.120132 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.120336 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.120434 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.120652 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.120747 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.120966 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.121063 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.121285 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.121388 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.121669 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.121853 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.121998 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.122181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.122335 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.122496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.122650 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.122810 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.122962 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.123142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.123319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.123458 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.123635 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.123772 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.123948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.124082 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.124261 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.124391 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.124577 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.124688 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.124887 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.124982 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.125196 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.125298 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.125510 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.125614 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.125840 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.125936 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.126149 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.126283 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.126479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.126575 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.126796 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.126891 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.127131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.127231 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.127446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.127542 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.127758 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.127853 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.128108 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.128218 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.128418 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.128522 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.128759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.128861 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.129084 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.129187 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.129412 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.129548 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.129723 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.129851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.130036 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.130139 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.130350 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.130445 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.130664 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.130760 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.130975 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.131134 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.131315 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.131423 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.131631 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.131733 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.132475 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.132572 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.132799 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.132900 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.133122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.133216 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.133696 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.133796 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.134012 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.134112 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.134329 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.134434 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.134648 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.134750 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.135203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.135307 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.135570 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.135688 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.135855 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.135951 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.136178 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.136273 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.136497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.136601 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.136812 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.136906 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.137128 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.137365 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.137466 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.137695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.137798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.138015 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.138118 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.138332 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.138439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.138647 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.138741 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.138948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.139080 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.139294 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.139471 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.139606 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.139742 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.139910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.140017 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.140229 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.140338 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.140539 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.140644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.140904 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.141078 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.141229 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.141429 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.141597 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.141738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.141921 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.142055 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.142234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.142379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.142556 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.142695 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.142880 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.142984 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.143239 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.143338 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.143561 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.143702 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.143880 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.144012 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.144201 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.144331 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.144521 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.144646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.144838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.144947 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.145155 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.145258 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.145479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.145575 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.145800 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.145906 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.146131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.146226 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.146440 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.146535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.146730 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.146825 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.147084 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.147197 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.147411 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.147535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.148341 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.148449 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.148629 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.148819 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.148924 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.149144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.149248 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.149484 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.149588 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.149818 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.149913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.150118 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.150225 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.150435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.150742 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.150852 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.151068 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.151240 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.151365 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.151469 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.151675 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.151779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.151979 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.152088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.152325 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.152436 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.152652 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.152794 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.152968 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.153076 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.153272 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.153376 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.153579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.153681 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.153896 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.154000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.154251 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.154362 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.154524 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.154625 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.154833 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.155090 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.155190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.155455 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.155550 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.155779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.155888 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.156111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.156330 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.156432 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.156670 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.156765 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.156993 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.157096 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.157331 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.157436 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.157666 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.157775 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.157977 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.158079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.158283 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.158384 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.158600 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.158704 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.158910 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.159012 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.159253 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.159359 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.159565 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.159675 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.159877 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.160019 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.160187 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.160290 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.160495 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.160603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.160805 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.160899 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.161113 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.161214 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.161422 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.161562 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.161731 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.161834 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.162039 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.162143 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.162347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.162443 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.162657 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.162750 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.162968 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.163613 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.163822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.163926 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.164136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.164229 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.164454 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.164555 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.164766 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.164861 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.165078 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.165173 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.165390 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.165495 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.165696 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.165797 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.166005 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.166099 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.166313 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.166421 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.166629 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.166723 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.166957 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.167111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.167298 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.167418 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.167605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.167710 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.167931 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.168025 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.168253 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.168350 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.168585 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.168687 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.168906 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.169009 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.169225 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.169328 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.169556 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.169657 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.169882 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.170024 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.170238 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.170427 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.170525 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.170776 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.170917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.171132 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.171246 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.171476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.171572 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.171806 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.171904 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.172122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.172217 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.172428 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.172530 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.172735 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.172840 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.173043 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.173149 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.173350 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.173446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.173669 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.173765 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.173982 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.174084 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.174288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.174390 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.174592 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.174696 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.174928 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.175054 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.175331 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.175432 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.175585 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.175696 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.175894 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.175997 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.176201 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.176306 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.176514 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.176620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.176819 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.176923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.177124 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.177227 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.177430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.177527 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.177734 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.177836 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.178039 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.178143 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.178344 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.178441 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.178680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.178777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.179578 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.179712 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.179818 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.179908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.180129 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.180224 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.180437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.180535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.180742 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.180838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.181077 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.181174 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.181415 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.181520 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.181726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.181865 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.182052 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.182192 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.182366 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.182471 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.182690 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.182785 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.183000 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.183167 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.183349 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.183461 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.183675 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.183780 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.183993 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.184096 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.184306 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.184404 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.184641 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.184735 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.184953 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.185050 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.185267 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.185372 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.185580 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.185675 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.185892 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.185995 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.186204 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.186302 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.186517 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.186619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.186846 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.186942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.187191 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.187290 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.187504 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.187632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.187821 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.187931 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.188134 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.188237 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.188445 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.188547 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.188756 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.188862 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.189067 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.189161 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.189376 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.189470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.189689 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.189792 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.189998 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.190100 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.190311 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.190487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.190620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.190712 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.190920 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.191015 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.191257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.191355 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.191569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.191674 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.191879 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.192027 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.192190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.192293 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.192499 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.192595 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.192815 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.192917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.193127 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.193221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.193439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.193586 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.193749 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.193845 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.194062 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.194172 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.194397 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.194495 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.194740 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.194836 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.195106 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.195261 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.195378 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:30:31.195501 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.195782 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.196103 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.196789 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.196988 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.197325 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.197827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.197972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.198286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.198626 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.198946 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.199292 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.199610 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.199930 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.200248 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.200567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.200903 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.201241 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.201547 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.201879 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.202204 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.202533 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.202857 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.203204 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.203542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.203863 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.204181 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.204506 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.204823 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.205140 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.205469 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.205821 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.206156 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.206489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.206825 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.207184 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.207548 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.207904 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.208501 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.208928 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.209256 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.209601 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.209883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:30:31.210164 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:30:31.219926 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_db.sqlalchemy.engines [None req-1b55b02a-5be9-46c1-9b84-d03322bf8011 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:30:31.233990 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_db.sqlalchemy.engines [None req-98565787-d323-4728-a2bd-1bd7f103fafd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:30:31.286311 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.context [None req-1b55b02a-5be9-46c1-9b84-d03322bf8011 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c0b44fa-5cb1-4cc9-b975-38d3ec19564b(cell1) {{(pid=118216) load_cells /opt/stack/nova/nova/context.py:464}} May 12 14:30:31.291329 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1b55b02a-5be9-46c1-9b84-d03322bf8011 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:30:31.292960 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1b55b02a-5be9-46c1-9b84-d03322bf8011 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:30:31.293777 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1b55b02a-5be9-46c1-9b84-d03322bf8011 None None] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:30:31.295744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1b55b02a-5be9-46c1-9b84-d03322bf8011 None None] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:30:31.298403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.context [None req-98565787-d323-4728-a2bd-1bd7f103fafd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9c0b44fa-5cb1-4cc9-b975-38d3ec19564b(cell1) {{(pid=118217) load_cells /opt/stack/nova/nova/context.py:464}} May 12 14:30:31.302807 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-98565787-d323-4728-a2bd-1bd7f103fafd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:30:31.305265 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-98565787-d323-4728-a2bd-1bd7f103fafd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:30:31.306301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-98565787-d323-4728-a2bd-1bd7f103fafd None None] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:30:31.308148 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_db.sqlalchemy.engines [None req-1b55b02a-5be9-46c1-9b84-d03322bf8011 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:30:31.308722 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-98565787-d323-4728-a2bd-1bd7f103fafd None None] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:30:31.309500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_db.sqlalchemy.engines [None req-1b55b02a-5be9-46c1-9b84-d03322bf8011 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:30:31.320061 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_db.sqlalchemy.engines [None req-98565787-d323-4728-a2bd-1bd7f103fafd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:30:31.321876 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_db.sqlalchemy.engines [None req-98565787-d323-4728-a2bd-1bd7f103fafd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:30:31.468862 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_db.sqlalchemy.engines [None req-1b55b02a-5be9-46c1-9b84-d03322bf8011 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:30:31.487446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_db.sqlalchemy.engines [None req-98565787-d323-4728-a2bd-1bd7f103fafd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:30:31.794507 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: WARNING keystonemiddleware.auth_token [None req-1b55b02a-5be9-46c1-9b84-d03322bf8011 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:30:31.802094 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: WARNING keystonemiddleware.auth_token [None req-1b55b02a-5be9-46c1-9b84-d03322bf8011 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:30:31.818641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: WARNING keystonemiddleware.auth_token [None req-98565787-d323-4728-a2bd-1bd7f103fafd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:30:31.826848 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: WARNING keystonemiddleware.auth_token [None req-98565787-d323-4728-a2bd-1bd7f103fafd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:30:32.177070 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: WARNING keystonemiddleware.auth_token [None req-1b55b02a-5be9-46c1-9b84-d03322bf8011 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:30:32.184288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: WARNING keystonemiddleware.auth_token [None req-1b55b02a-5be9-46c1-9b84-d03322bf8011 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:30:32.189775 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561232e7c9c0 pid: 118216 (default app) May 12 14:30:32.197901 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: WARNING keystonemiddleware.auth_token [None req-98565787-d323-4728-a2bd-1bd7f103fafd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:30:32.204161 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: WARNING keystonemiddleware.auth_token [None req-98565787-d323-4728-a2bd-1bd7f103fafd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:30:32.209537 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561232e7c9c0 pid: 118217 (default app) May 12 14:31:15.246968 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4a02e5a7-84c3-4947-ad70-08ba2e29e20b tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] Action: 'create', calling method: .version_select at 0x7f5b2892d280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1005564022", "metadata": {"Type": "work"}}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:31:15.705059 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0305f076-bb58-47f5-a2c9-6a78597943aa tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Action: 'create', calling method: .version_select at 0x7f5b2892d280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1982123555"}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:31:17.922496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4a02e5a7-84c3-4947-ad70-08ba2e29e20b tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.093642 May 12 14:31:17.923377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 1/1] 10.222.0.75 () {60 vars in 1155 bytes} [Thu May 12 14:31:13 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4096 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 14:31:17.953028 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-de5d0eed-c34d-47ef-82c6-ecf8093b514e tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] Calling method '.version_select at 0x7f5b28785280>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:18.240228 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-de5d0eed-c34d-47ef-82c6-ecf8093b514e tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/847bc573-7e4f-457b-b714-511200e86872" status: 200 len: 353 microversion: 2.1 time: 0.308090 May 12 14:31:18.240751 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 2/2] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 12 14:31:17 2022] GET /compute/v2.1/os-volumes/847bc573-7e4f-457b-b714-511200e86872 => generated 353 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:31:18.576434 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0305f076-bb58-47f5-a2c9-6a78597943aa tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.295677 May 12 14:31:18.577218 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 1/3] 10.222.0.75 () {60 vars in 1154 bytes} [Thu May 12 14:31:14 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4299 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 14:31:18.590503 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-45d34947-897c-45b1-b1db-e82ed4effea6 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b28785430>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:18.792920 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-45d34947-897c-45b1-b1db-e82ed4effea6 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e" status: 200 len: 345 microversion: 2.1 time: 0.206002 May 12 14:31:18.793960 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 3/4] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 12 14:31:18 2022] GET /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e => generated 345 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:19.253795 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a68ef8a6-9af1-4141-8c2e-45a0ce8c6f5d tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] Calling method '.version_select at 0x7f5b28787280>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:19.369009 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a68ef8a6-9af1-4141-8c2e-45a0ce8c6f5d tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/847bc573-7e4f-457b-b714-511200e86872" status: 200 len: 354 microversion: 2.1 time: 0.119339 May 12 14:31:19.369871 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 2/5] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 12 14:31:19 2022] GET /compute/v2.1/os-volumes/847bc573-7e4f-457b-b714-511200e86872 => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:19.384077 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2ef7e87a-2e5c-4cd5-a033-fe58e386e5c9 tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] Calling method '.version_select at 0x7f5b28785a60>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:19.486863 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2ef7e87a-2e5c-4cd5-a033-fe58e386e5c9 tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/847bc573-7e4f-457b-b714-511200e86872" status: 200 len: 354 microversion: 2.1 time: 0.099304 May 12 14:31:19.486863 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 4/6] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 12 14:31:19 2022] GET /compute/v2.1/os-volumes/847bc573-7e4f-457b-b714-511200e86872 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:19.503176 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c97e5d45-010a-4ad9-a4b4-e11337f17d3a tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] Calling method '.version_select at 0x7f5b28787310>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:19.633979 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c97e5d45-010a-4ad9-a4b4-e11337f17d3a tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/847bc573-7e4f-457b-b714-511200e86872" status: 202 len: 0 microversion: 2.1 time: 0.136093 May 12 14:31:19.635548 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 3/7] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 12 14:31:19 2022] DELETE /compute/v2.1/os-volumes/847bc573-7e4f-457b-b714-511200e86872 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:31:19.649338 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c2935299-31c5-4d83-98e8-91ce533e40b3 tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] Calling method '.version_select at 0x7f5b2878e160>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:19.735406 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c2935299-31c5-4d83-98e8-91ce533e40b3 tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/847bc573-7e4f-457b-b714-511200e86872" status: 200 len: 353 microversion: 2.1 time: 0.095751 May 12 14:31:19.736185 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 5/8] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 12 14:31:19 2022] GET /compute/v2.1/os-volumes/847bc573-7e4f-457b-b714-511200e86872 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:19.806463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9cdfd49f-68bf-411d-b53b-5365c1cdebe3 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b28785d30>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:19.913425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9cdfd49f-68bf-411d-b53b-5365c1cdebe3 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e" status: 200 len: 346 microversion: 2.1 time: 0.111130 May 12 14:31:19.914141 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 6/9] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 12 14:31:19 2022] GET /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e => generated 346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:31:19.926878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2955ae5f-5459-46b4-ac38-98a4e98a6f9c tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Action: 'create', calling method: .version_select at 0x7f5b28785670>, body: {"snapshot": {"volume_id": "9ed2495e-63bc-4d68-9631-523f7769720e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-630164666"}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:31:20.267890 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2955ae5f-5459-46b4-ac38-98a4e98a6f9c tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.345567 May 12 14:31:20.269758 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 7/10] 10.222.0.75 () {60 vars in 1161 bytes} [Thu May 12 14:31:19 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:20.279766 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-86cc310b-7c81-4e79-98bc-78a12569675e tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b2878e040>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:20.448886 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-86cc310b-7c81-4e79-98bc-78a12569675e tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a" status: 200 len: 286 microversion: 2.1 time: 0.173767 May 12 14:31:20.450770 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 8/11] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 12 14:31:20 2022] GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a => generated 286 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:20.463910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-90c94b1e-3c3a-438c-9fbf-f7bf23e333bf tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b287853a0>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:20.531398 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1128106396", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "networks": [{"uuid": "c6afaeb2-6560-413e-a386-228bf2d708db"}]}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:31:20.558645 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-90c94b1e-3c3a-438c-9fbf-f7bf23e333bf tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.102020 May 12 14:31:20.559532 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 9/12] 10.222.0.75 () {58 vars in 1139 bytes} [Thu May 12 14:31:20 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:20.571846 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f188af0f-2b20-4c15-bde8-ae9fa8607fc1 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b2878ea60>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:20.630584 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f188af0f-2b20-4c15-bde8-ae9fa8607fc1 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a" status: 200 len: 286 microversion: 2.1 time: 0.063845 May 12 14:31:20.642170 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 10/13] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 12 14:31:20 2022] GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:31:20.712628 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.network.neutron [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] validate_networks() for [('c6afaeb2-6560-413e-a386-228bf2d708db', None, None, None, None, None)] {{(pid=118217) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:31:20.752862 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-82e1a857-1fbc-4bb6-bd31-83897d72ed23 tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] Calling method '.version_select at 0x7f5b2878e700>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:20.813001 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-82e1a857-1fbc-4bb6-bd31-83897d72ed23 tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] HTTP exception thrown: Volume 847bc573-7e4f-457b-b714-511200e86872 could not be found. May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-82e1a857-1fbc-4bb6-bd31-83897d72ed23 tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] Request method failure captured: May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/os-volumes/847bc573-7e4f-457b-b714-511200e86872 HTTP/1.1 May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRoxYn3a1RYw9frWb7qpND6oUyGG75eRf0jAsxQbE_E55g5rlIF2yXDbBx1U1TqpnT9A4NlZ7hyPkx3eFFo-PoCKBS3vwihtKbRwAsmGzPvqxSYhnfvaR5lc3yPhPNGrdwZTVUd5Wxxq45_YrF4l2joLf3K9yEHho7Ma5O_laHIGkQI May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 3be0839a5f6b49f5be6ae6adea94883b May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-VolumesGetTestJSON-1378137379 May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:31:20.830419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:31:20.833913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3be0839a5f6b49f5be6ae6adea94883b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3be0839a5f6b49f5be6ae6adea94883b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3be0839a5f6b49f5be6ae6adea94883b", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3be0839a5f6b49f5be6ae6adea94883b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:31:20.833913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-VolumesGetTestJSON-1378137379 May 12 14:31:20.833913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 3be0839a5f6b49f5be6ae6adea94883b May 12 14:31:20.833913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-VolumesGetTestJSON-1378137379 May 12 14:31:20.833913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-VolumesGetTestJSON-1378137379-project May 12 14:31:20.833913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:31:20.833913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:31:20.833913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: dfb54adc3da14a21a903d9025ad60881 May 12 14:31:20.833913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-VolumesGetTestJSON-1378137379-project May 12 14:31:20.833913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: May 12 14:31:20.833913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Volume 847bc573-7e4f-457b-b714-511200e86872 could not be found. May 12 14:31:20.833913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '847bc573-7e4f-457b-b714-511200e86872'} May 12 14:31:20.833913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 847bc573-7e4f-457b-b714-511200e86872 could not be found. (HTTP 404) (Request-ID: req-c033801c-df49-4ea0-a1a7-af14da7a8608) May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:20.836541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:31:20.885260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 847bc573-7e4f-457b-b714-511200e86872 could not be found. May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 14:31:20.897333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:31:20.899362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 847bc573-7e4f-457b-b714-511200e86872 could not be found. May 12 14:31:20.899362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:20.899362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:20.899362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:20.899362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:20.899362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:20.899362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:20.899362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:31:20.899362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:31:20.899362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 847bc573-7e4f-457b-b714-511200e86872 could not be found. May 12 14:31:20.899362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:20.899362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-82e1a857-1fbc-4bb6-bd31-83897d72ed23 tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] Returning 404 to user: Volume 847bc573-7e4f-457b-b714-511200e86872 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:31:20.899362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-82e1a857-1fbc-4bb6-bd31-83897d72ed23 tempest-VolumesGetTestJSON-1378137379 tempest-VolumesGetTestJSON-1378137379-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/847bc573-7e4f-457b-b714-511200e86872" status: 404 len: 109 microversion: 2.1 time: 0.100125 May 12 14:31:20.899362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 11/14] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 12 14:31:20 2022] GET /compute/v2.1/os-volumes/847bc573-7e4f-457b-b714-511200e86872 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:31:21.652033 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9bbeac25-ae90-4e2d-8966-c64d5606fc2d tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b2878e430>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:21.725097 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9bbeac25-ae90-4e2d-8966-c64d5606fc2d tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a" status: 200 len: 286 microversion: 2.1 time: 0.085305 May 12 14:31:21.725856 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 12/15] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 12 14:31:21 2022] GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:22.738820 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7a48e808-dfaf-4cbf-b96c-3fd798bdf2fe tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b286ff3a0>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:22.797099 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7a48e808-dfaf-4cbf-b96c-3fd798bdf2fe tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a" status: 200 len: 286 microversion: 2.1 time: 0.063613 May 12 14:31:22.797875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 13/16] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 12 14:31:22 2022] GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:23.511583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Flavor limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:31:23.512117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Image limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:31:23.512573 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Flavor pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:31:23.513156 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Image pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:31:23.513614 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:31:23.541326 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:23.546562 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:23.547462 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:23.548042 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:23.634629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Getting quotas for project 5595513cb114487cb476e609d069709b. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:31:23.660570 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Getting quotas for user 1e59323f23bd40928544cfac604a5270 and project 5595513cb114487cb476e609d069709b. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:31:23.711827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Going to run 1 instances... {{(pid=118217) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:31:23.715463 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:31:23.808836 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-fadc5bd3-b807-49de-8a16-40163c81e2a3 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b2878e9d0>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:23.893759 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-fadc5bd3-b807-49de-8a16-40163c81e2a3 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a" status: 200 len: 286 microversion: 2.1 time: 0.088598 May 12 14:31:23.894340 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 14/17] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 12 14:31:23 2022] GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:31:23.955019 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bbaaee1c-0e0b-4c2d-b064-32740fce46ef tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.181713 May 12 14:31:23.958768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 4/18] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:31:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 4187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:31:23.969437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-094f5329-addc-4a2c-8e66-e114d059d4e9 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:23.970326 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-094f5329-addc-4a2c-8e66-e114d059d4e9 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:24.372442 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-094f5329-addc-4a2c-8e66-e114d059d4e9 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:24.409843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-094f5329-addc-4a2c-8e66-e114d059d4e9 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1215 microversion: 2.1 time: 0.444808 May 12 14:31:24.413075 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 15/19] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:23 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1215 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:24.908228 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-74c45800-c051-478b-a9b4-0a1214ad57d3 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b27e8fee0>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:25.025794 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-74c45800-c051-478b-a9b4-0a1214ad57d3 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a" status: 200 len: 286 microversion: 2.1 time: 0.122529 May 12 14:31:25.026372 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 5/20] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 12 14:31:24 2022] GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a => generated 286 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:25.435699 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c1643160-56d3-4b74-a742-cd4b4b900a2c tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:25.436323 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c1643160-56d3-4b74-a742-cd4b4b900a2c tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:25.785346 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c1643160-56d3-4b74-a742-cd4b4b900a2c tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:25.795283 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c1643160-56d3-4b74-a742-cd4b4b900a2c tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1215 microversion: 2.1 time: 0.361046 May 12 14:31:25.796509 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 16/21] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:25 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1215 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:26.046526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a9bacb1a-e47d-4204-bbc5-b42ee1fd6877 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b27ea3670>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:26.144712 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a9bacb1a-e47d-4204-bbc5-b42ee1fd6877 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a" status: 200 len: 286 microversion: 2.1 time: 0.108331 May 12 14:31:26.145398 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 6/22] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 12 14:31:26 2022] GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:26.813573 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-954f3de1-1f02-4193-87b5-0a6809ca4805 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:26.814190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-954f3de1-1f02-4193-87b5-0a6809ca4805 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:26.833284 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-954f3de1-1f02-4193-87b5-0a6809ca4805 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:26.834003 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-954f3de1-1f02-4193-87b5-0a6809ca4805 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:26.835449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-954f3de1-1f02-4193-87b5-0a6809ca4805 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:26.836048 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-954f3de1-1f02-4193-87b5-0a6809ca4805 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:27.146758 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-954f3de1-1f02-4193-87b5-0a6809ca4805 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:27.185602 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-954f3de1-1f02-4193-87b5-0a6809ca4805 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1219 microversion: 2.1 time: 0.377106 May 12 14:31:27.189076 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 7/23] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:26 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1219 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:27.440677 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2900f6fa-f258-4fd3-bcf7-1d84e4b8abbe tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Action: 'create', calling method: .version_select at 0x7f5b2873a1f0>, body: {"keypair": {"name": "tempest-keypair-586766621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2ajI+PzJMeWwBVFDIU0THVcUWIQhmMTt8x0esR+wDz5Y2yPqmh7GMPhKPnQD/VD5fESCOoffQfhy3h31Ub6mjOnMXyYcFqTZY59VSUSiyq1mXxyc+/Tdnjrdenc11vrA=="}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:31:27.494589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-2900f6fa-f258-4fd3-bcf7-1d84e4b8abbe tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Getting quotas for project 202791457f0749649e8cc096f6e43404. Resources: {'key_pairs'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:31:27.504277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-2900f6fa-f258-4fd3-bcf7-1d84e4b8abbe tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Getting quotas for user c3b76edcb338405a9bf2f68e91dfacdd and project 202791457f0749649e8cc096f6e43404. Resources: {'key_pairs'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:31:27.597892 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2900f6fa-f258-4fd3-bcf7-1d84e4b8abbe tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.819278 May 12 14:31:27.600124 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 17/24] 10.222.0.75 () {62 vars in 1199 bytes} [Thu May 12 14:31:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 822 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 14:31:27.605894 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3c3c4448-5788-4417-9d4b-80e7b22496f8 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b28686f70>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:27.657523 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3c3c4448-5788-4417-9d4b-80e7b22496f8 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a" status: 200 len: 287 microversion: 2.1 time: 0.055912 May 12 14:31:27.663767 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 18/25] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 12 14:31:27 2022] GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:27.670453 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d735075a-72f4-4e65-8d39-2a08a3b51a19 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b27e3d670>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:27.787356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d735075a-72f4-4e65-8d39-2a08a3b51a19 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "DELETE /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a" status: 202 len: 0 microversion: 2.1 time: 0.121255 May 12 14:31:27.788560 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 19/26] 10.222.0.75 () {58 vars in 1253 bytes} [Thu May 12 14:31:27 2022] DELETE /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:31:27.791295 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4249d393-8609-4592-adf4-b78045584e05 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Action: 'create', calling method: .version_select at 0x7f5b27ea33a0>, body: {"keypair": {"name": "tempest-keypair-1639837625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLS8FYb22L66QyOU3u0l5ur+ShH3UVMQ9P1HjB9vYA13rtYttBCwmK0XgQZbX+HaP5mpnK+qNl78KLgKpgNXpXjtvo/nZusA1EVTk8y3WngsCeaE6Dgs9jNrvj9BUFEB9A=="}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:31:27.796818 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e132b5d5-087f-4206-9d2c-4319288e7836 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b28686790>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:27.835453 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-4249d393-8609-4592-adf4-b78045584e05 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for project e4b5ca018b5f4dda99486407424b8168. Resources: {'key_pairs'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:31:27.846390 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-4249d393-8609-4592-adf4-b78045584e05 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for user c6422873a3b84aac88f8a93291bcd7b0 and project e4b5ca018b5f4dda99486407424b8168. Resources: {'key_pairs'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:31:27.855499 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e132b5d5-087f-4206-9d2c-4319288e7836 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a" status: 200 len: 286 microversion: 2.1 time: 0.063047 May 12 14:31:27.859725 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 20/27] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 12 14:31:27 2022] GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:31:27.948335 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4249d393-8609-4592-adf4-b78045584e05 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.757849 May 12 14:31:27.950321 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 8/28] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 12 14:31:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:28.201810 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ec877ee4-e916-4ea2-967c-5f0defb7fbaf tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:28.202648 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ec877ee4-e916-4ea2-967c-5f0defb7fbaf tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:28.215585 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec877ee4-e916-4ea2-967c-5f0defb7fbaf tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:28.217982 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec877ee4-e916-4ea2-967c-5f0defb7fbaf tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:28.218892 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec877ee4-e916-4ea2-967c-5f0defb7fbaf tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:28.221624 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec877ee4-e916-4ea2-967c-5f0defb7fbaf tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:28.588185 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ec877ee4-e916-4ea2-967c-5f0defb7fbaf tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:28.607981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ec877ee4-e916-4ea2-967c-5f0defb7fbaf tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1273 microversion: 2.1 time: 0.409973 May 12 14:31:28.611589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 21/29] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:28 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1273 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:28.867850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f4065895-9f88-41dd-a4b3-4c0fec8221f9 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b2758d280>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:28.915008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-f4065895-9f88-41dd-a4b3-4c0fec8221f9 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] HTTP exception thrown: Snapshot a0200f93-531f-49fd-adbd-ca6d6595a53a could not be found. May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f4065895-9f88-41dd-a4b3-4c0fec8221f9 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Request method failure captured: May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a HTTP/1.1 May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRoy5ZADcJUg9j-Yg6Sh1wax8Htr_lF1aMCVjCesFoqwDndDKUEWyGm32dsUoRYEEgiDGqNIpAUPBs2pEkOhOZ_yvyBquiZFsuJDq9rylBzr01PT_zkEOaUhttodaXWtBFYjxCT6QSVQR4oj1c2nzla6BzceTBt557QajUFWtvGwaOg May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: b7ed5932615343aa9d806ed2a38c603d May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1910240867 May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:31:28.928111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:31:28.929144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b7ed5932615343aa9d806ed2a38c603d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b7ed5932615343aa9d806ed2a38c603d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b7ed5932615343aa9d806ed2a38c603d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b7ed5932615343aa9d806ed2a38c603d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:31:28.929144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1910240867 May 12 14:31:28.929144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: b7ed5932615343aa9d806ed2a38c603d May 12 14:31:28.929144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1910240867 May 12 14:31:28.929144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-VolumesSnapshotsTestJSON-1910240867-project May 12 14:31:28.929144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:31:28.929144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:31:28.929144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: 03d540e2706a4c3491629f6b8fc40ff9 May 12 14:31:28.929144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1910240867-project May 12 14:31:28.929144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: May 12 14:31:28.929144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Snapshot a0200f93-531f-49fd-adbd-ca6d6595a53a could not be found. May 12 14:31:28.929144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': 'a0200f93-531f-49fd-adbd-ca6d6595a53a'} May 12 14:31:28.929144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a0200f93-531f-49fd-adbd-ca6d6595a53a could not be found. (HTTP 404) (Request-ID: req-2ce0f634-d8c5-40af-b28f-70e472b0151b) May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:28.929759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:31:28.930695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a0200f93-531f-49fd-adbd-ca6d6595a53a could not be found. May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 12 14:31:28.931603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:31:28.932569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a0200f93-531f-49fd-adbd-ca6d6595a53a could not be found. May 12 14:31:28.932569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:28.932569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:28.932569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:28.932569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:28.932569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:28.932569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:28.932569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:31:28.932569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:31:28.932569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a0200f93-531f-49fd-adbd-ca6d6595a53a could not be found. May 12 14:31:28.932569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:28.932569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f4065895-9f88-41dd-a4b3-4c0fec8221f9 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Returning 404 to user: Snapshot a0200f93-531f-49fd-adbd-ca6d6595a53a could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:31:28.933214 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f4065895-9f88-41dd-a4b3-4c0fec8221f9 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a" status: 404 len: 111 microversion: 2.1 time: 0.069952 May 12 14:31:28.935876 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 9/30] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 12 14:31:28 2022] GET /compute/v2.1/os-snapshots/a0200f93-531f-49fd-adbd-ca6d6595a53a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:31:28.952336 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-14142bd2-1700-416c-9adb-6183f53e8774 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b27dc9b80>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:29.111375 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-14142bd2-1700-416c-9adb-6183f53e8774 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e" status: 202 len: 0 microversion: 2.1 time: 0.170547 May 12 14:31:29.112220 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 22/31] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 12 14:31:28 2022] DELETE /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:31:29.122462 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-17ae0ed3-4e08-4455-9ac1-45af3c482daa tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b26d6f550>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:29.218467 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-17ae0ed3-4e08-4455-9ac1-45af3c482daa tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e" status: 200 len: 345 microversion: 2.1 time: 0.101083 May 12 14:31:29.219505 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 10/32] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 12 14:31:29 2022] GET /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e => generated 345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:29.639861 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-66c602c8-c578-43b5-a438-a24d3d26bf9d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:29.640840 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-66c602c8-c578-43b5-a438-a24d3d26bf9d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:29.662642 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-66c602c8-c578-43b5-a438-a24d3d26bf9d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:29.665771 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-66c602c8-c578-43b5-a438-a24d3d26bf9d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:29.668254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-66c602c8-c578-43b5-a438-a24d3d26bf9d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:29.679803 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-66c602c8-c578-43b5-a438-a24d3d26bf9d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:30.056820 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-66c602c8-c578-43b5-a438-a24d3d26bf9d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:30.069783 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-66c602c8-c578-43b5-a438-a24d3d26bf9d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1273 microversion: 2.1 time: 0.433460 May 12 14:31:30.070572 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 23/33] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:29 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1273 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:30.236508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-da5173eb-9a1a-4448-b98e-1cd446fa1d52 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b26d6f040>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:30.307781 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-da5173eb-9a1a-4448-b98e-1cd446fa1d52 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] HTTP exception thrown: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-da5173eb-9a1a-4448-b98e-1cd446fa1d52 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Request method failure captured: May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e HTTP/1.1 May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRoy5ZADcJUg9j-Yg6Sh1wax8Htr_lF1aMCVjCesFoqwDndDKUEWyGm32dsUoRYEEgiDGqNIpAUPBs2pEkOhOZ_yvyBquiZFsuJDq9rylBzr01PT_zkEOaUhttodaXWtBFYjxCT6QSVQR4oj1c2nzla6BzceTBt557QajUFWtvGwaOg May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: b7ed5932615343aa9d806ed2a38c603d May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1910240867 May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:31:30.313522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:31:30.315183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b7ed5932615343aa9d806ed2a38c603d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b7ed5932615343aa9d806ed2a38c603d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b7ed5932615343aa9d806ed2a38c603d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b7ed5932615343aa9d806ed2a38c603d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:31:30.315183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1910240867 May 12 14:31:30.315183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: b7ed5932615343aa9d806ed2a38c603d May 12 14:31:30.315183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1910240867 May 12 14:31:30.315183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-VolumesSnapshotsTestJSON-1910240867-project May 12 14:31:30.315183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:31:30.315183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:31:30.315183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: 03d540e2706a4c3491629f6b8fc40ff9 May 12 14:31:30.315183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1910240867-project May 12 14:31:30.315183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: May 12 14:31:30.315183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. May 12 14:31:30.315183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': '9ed2495e-63bc-4d68-9631-523f7769720e'} May 12 14:31:30.315183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. (HTTP 404) (Request-ID: req-15df49f4-60ea-4d1a-a03c-75bb085aa8a2) May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:30.315923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:31:30.316984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 14:31:30.318498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:31:30.319526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. May 12 14:31:30.319526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:30.319526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:30.319526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:30.319526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:30.319526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:30.319526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:30.319526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:31:30.319526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:31:30.319526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. May 12 14:31:30.319526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:30.319526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-da5173eb-9a1a-4448-b98e-1cd446fa1d52 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Returning 404 to user: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:31:30.319526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-da5173eb-9a1a-4448-b98e-1cd446fa1d52 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e" status: 404 len: 109 microversion: 2.1 time: 0.087996 May 12 14:31:30.319526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 11/34] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 12 14:31:30 2022] GET /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:31:30.330976 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8f609b38-df81-444e-b7c4-41cddf44e1f0 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b27e3d0d0>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:30.385018 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-8f609b38-df81-444e-b7c4-41cddf44e1f0 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] HTTP exception thrown: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8f609b38-df81-444e-b7c4-41cddf44e1f0 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Request method failure captured: May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: DELETE /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e HTTP/1.1 May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRoy5ZADcJUg9j-Yg6Sh1wax8Htr_lF1aMCVjCesFoqwDndDKUEWyGm32dsUoRYEEgiDGqNIpAUPBs2pEkOhOZ_yvyBquiZFsuJDq9rylBzr01PT_zkEOaUhttodaXWtBFYjxCT6QSVQR4oj1c2nzla6BzceTBt557QajUFWtvGwaOg May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: b7ed5932615343aa9d806ed2a38c603d May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1910240867 May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:31:30.388203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:31:30.389425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b7ed5932615343aa9d806ed2a38c603d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b7ed5932615343aa9d806ed2a38c603d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b7ed5932615343aa9d806ed2a38c603d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b7ed5932615343aa9d806ed2a38c603d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:31:30.389425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1910240867 May 12 14:31:30.389425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: b7ed5932615343aa9d806ed2a38c603d May 12 14:31:30.389425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1910240867 May 12 14:31:30.389425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-VolumesSnapshotsTestJSON-1910240867-project May 12 14:31:30.389425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:31:30.389425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:31:30.389425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: 03d540e2706a4c3491629f6b8fc40ff9 May 12 14:31:30.389425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1910240867-project May 12 14:31:30.389425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: May 12 14:31:30.389425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. May 12 14:31:30.389425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '9ed2495e-63bc-4d68-9631-523f7769720e'} May 12 14:31:30.389425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. (HTTP 404) (Request-ID: req-8021e040-4909-4022-b18a-59e562177f2a) May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:30.390037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 14:31:30.390914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 14:31:30.391981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:31:30.392878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. May 12 14:31:30.392878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:30.392878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:30.392878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:30.392878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:30.392878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:30.392878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:30.392878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:31:30.392878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:31:30.392878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. May 12 14:31:30.392878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:30.392878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8f609b38-df81-444e-b7c4-41cddf44e1f0 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Returning 404 to user: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:31:30.392878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8f609b38-df81-444e-b7c4-41cddf44e1f0 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e" status: 404 len: 109 microversion: 2.1 time: 0.066264 May 12 14:31:30.395542 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 24/35] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 12 14:31:30 2022] DELETE /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:31:30.400404 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b3abba66-0b24-40a3-8c1e-c14330f6ff32 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Calling method '.version_select at 0x7f5b26d6fee0>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:30.456497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-b3abba66-0b24-40a3-8c1e-c14330f6ff32 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] HTTP exception thrown: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b3abba66-0b24-40a3-8c1e-c14330f6ff32 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Request method failure captured: May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e HTTP/1.1 May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRoy5ZADcJUg9j-Yg6Sh1wax8Htr_lF1aMCVjCesFoqwDndDKUEWyGm32dsUoRYEEgiDGqNIpAUPBs2pEkOhOZ_yvyBquiZFsuJDq9rylBzr01PT_zkEOaUhttodaXWtBFYjxCT6QSVQR4oj1c2nzla6BzceTBt557QajUFWtvGwaOg May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: b7ed5932615343aa9d806ed2a38c603d May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1910240867 May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:31:30.458640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:31:30.459761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b7ed5932615343aa9d806ed2a38c603d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b7ed5932615343aa9d806ed2a38c603d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b7ed5932615343aa9d806ed2a38c603d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b7ed5932615343aa9d806ed2a38c603d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:31:30.459761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1910240867 May 12 14:31:30.459761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: b7ed5932615343aa9d806ed2a38c603d May 12 14:31:30.459761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1910240867 May 12 14:31:30.459761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-VolumesSnapshotsTestJSON-1910240867-project May 12 14:31:30.459761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:31:30.459761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:31:30.459761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: 03d540e2706a4c3491629f6b8fc40ff9 May 12 14:31:30.459761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1910240867-project May 12 14:31:30.459761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: May 12 14:31:30.459761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. May 12 14:31:30.459761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': '9ed2495e-63bc-4d68-9631-523f7769720e'} May 12 14:31:30.459761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. (HTTP 404) (Request-ID: req-43b140cd-a967-4967-97ac-73dc8a29c380) May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:30.460382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:31:30.461257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 14:31:30.462122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:31:30.463073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. May 12 14:31:30.463073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:30.463073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:30.463073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:30.463073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:30.463073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:30.463073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:30.463073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:31:30.463073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:31:30.463073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. May 12 14:31:30.463073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:30.463073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b3abba66-0b24-40a3-8c1e-c14330f6ff32 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] Returning 404 to user: Volume 9ed2495e-63bc-4d68-9631-523f7769720e could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:31:30.463073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b3abba66-0b24-40a3-8c1e-c14330f6ff32 tempest-VolumesSnapshotsTestJSON-1910240867 tempest-VolumesSnapshotsTestJSON-1910240867-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e" status: 404 len: 109 microversion: 2.1 time: 0.063782 May 12 14:31:30.463073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 12/36] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 12 14:31:30 2022] GET /compute/v2.1/os-volumes/9ed2495e-63bc-4d68-9631-523f7769720e => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:31:31.087686 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3e06840a-becc-4147-a9d9-67c62fb5ff29 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:31.089286 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3e06840a-becc-4147-a9d9-67c62fb5ff29 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:31.122603 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3e06840a-becc-4147-a9d9-67c62fb5ff29 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:31.124947 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3e06840a-becc-4147-a9d9-67c62fb5ff29 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:31.133072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3e06840a-becc-4147-a9d9-67c62fb5ff29 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:31.133867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3e06840a-becc-4147-a9d9-67c62fb5ff29 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:31.848528 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3e06840a-becc-4147-a9d9-67c62fb5ff29 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:31.856604 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3e06840a-becc-4147-a9d9-67c62fb5ff29 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.773090 May 12 14:31:31.857199 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 25/37] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:31 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:32.873903 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7fd25e5c-3f86-459c-9632-c8214bc349f5 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:32.874660 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7fd25e5c-3f86-459c-9632-c8214bc349f5 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:32.882720 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7fd25e5c-3f86-459c-9632-c8214bc349f5 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:32.894287 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7fd25e5c-3f86-459c-9632-c8214bc349f5 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:32.907199 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7fd25e5c-3f86-459c-9632-c8214bc349f5 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:32.908115 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7fd25e5c-3f86-459c-9632-c8214bc349f5 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:33.162862 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1572792903", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fdc0b19-4053-4c44-8b08-cd1ab3959461"}], "security_groups": [{"name": "tempest-securitygroup--1692920831"}], "key_name": "tempest-keypair-1639837625", "user_data": "}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:31:33.983842 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7fd25e5c-3f86-459c-9632-c8214bc349f5 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:33.995873 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7fd25e5c-3f86-459c-9632-c8214bc349f5 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 1.123507 May 12 14:31:33.999146 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 13/38] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:32 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:34.104650 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.network.neutron [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] validate_networks() for [('3fdc0b19-4053-4c44-8b08-cd1ab3959461', None, None, None, None, None)] {{(pid=118216) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:31:35.023466 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9e458cdf-5d9c-4eb8-9250-b0e219705f69 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:35.024023 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9e458cdf-5d9c-4eb8-9250-b0e219705f69 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:35.075741 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9e458cdf-5d9c-4eb8-9250-b0e219705f69 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:35.076672 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9e458cdf-5d9c-4eb8-9250-b0e219705f69 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:35.083283 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9e458cdf-5d9c-4eb8-9250-b0e219705f69 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:35.084039 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9e458cdf-5d9c-4eb8-9250-b0e219705f69 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:36.076359 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9e458cdf-5d9c-4eb8-9250-b0e219705f69 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:36.084277 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9e458cdf-5d9c-4eb8-9250-b0e219705f69 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 1.067313 May 12 14:31:36.094058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 14/39] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:35 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:36.318276 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5a0d7956-e579-4bb3-80a4-fd630b01dfb4 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Action: 'create', calling method: .version_select at 0x7f5b26d20af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-516150832", "metadata": {"Type": "work"}}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5a0d7956-e579-4bb3-80a4-fd630b01dfb4 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Request method failure captured: May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 121 May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRpHZb3BW_Wk-FcJ4AaxVPw6bFWnGRbdrQZaT1SDLBn2rzqScj8JsMDqmWPYbl7daVhmLg2cCJ0N9zJUGaiii6PqiPYIkXNRepdjE7wqe4r1v28uiXY1PVWwcgrGGyMMPapf_LRMNthQg-G360jxr3NxQHTocBhWkSl5unCWKeNO1p0 May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 25dba82031df4b04a81213933bddf78e May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-VolumesNegativeTest-1587487283 May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:31:36.355594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:31:36.356728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/25dba82031df4b04a81213933bddf78e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/25dba82031df4b04a81213933bddf78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_25dba82031df4b04a81213933bddf78e", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/25dba82031df4b04a81213933bddf78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:31:36.356728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-VolumesNegativeTest-1587487283 May 12 14:31:36.356728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 25dba82031df4b04a81213933bddf78e May 12 14:31:36.356728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-VolumesNegativeTest-1587487283 May 12 14:31:36.356728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-VolumesNegativeTest-1587487283-project May 12 14:31:36.356728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:31:36.356728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:31:36.356728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: bd29830540b64091bdbafd09000e0813 May 12 14:31:36.356728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-VolumesNegativeTest-1587487283-project May 12 14:31:36.356728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: May 12 14:31:36.356728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-516150832", "metadata": {"Type": "work"}}} May 12 14:31:36.356728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: May 12 14:31:36.356728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-516150832', 'metadata': {'Type': 'work'}}}} May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise error May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi '#$%' May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:31:36.357403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 14:31:36.358768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 14:31:36.359892 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 14:31:36.359892 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:36.360945 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5a0d7956-e579-4bb3-80a4-fd630b01dfb4 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:31:36.362286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5a0d7956-e579-4bb3-80a4-fd630b01dfb4 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.269205 May 12 14:31:36.363338 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 15/40] 10.222.0.75 () {60 vars in 1155 bytes} [Thu May 12 14:31:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 271 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 14:31:36.371599 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-838660931", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a850f271-3b32-48bf-8bb5-be1eb540a3d0"}], "security_groups": [{"name": "tempest-securitygroup--414826305"}], "key_name": "tempest-keypair-586766621", "user_data": "}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:31:36.870246 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.network.neutron [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] validate_networks() for [('a850f271-3b32-48bf-8bb5-be1eb540a3d0', None, None, None, None, None)] {{(pid=118217) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:31:36.929728 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Flavor limits 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:31:36.930293 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Image limits 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:31:36.930940 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Flavor pref 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:31:36.931440 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Image pref 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:31:36.931868 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:31:36.956725 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:36.957985 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:36.960047 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:36.960740 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:36.994701 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for project e4b5ca018b5f4dda99486407424b8168. Resources: {'cores', 'instances', 'ram'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:31:36.999167 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for user c6422873a3b84aac88f8a93291bcd7b0 and project e4b5ca018b5f4dda99486407424b8168. Resources: {'cores', 'instances', 'ram'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:31:37.012759 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Going to run 1 instances... {{(pid=118216) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:31:37.017542 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:31:37.180562 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-90e1830e-899e-4e45-b3fc-f7c7f9c99924 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.033664 May 12 14:31:37.184168 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 26/41] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:31:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 4037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:31:37.189757 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7fee105a-27f4-41cc-8e91-f262d6cf4c69 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Action: 'create', calling method: .version_select at 0x7f5b27d291f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1895519675", "metadata": {"Type": "work"}}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7fee105a-27f4-41cc-8e91-f262d6cf4c69 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Request method failure captured: May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 120 May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRpHZb3BW_Wk-FcJ4AaxVPw6bFWnGRbdrQZaT1SDLBn2rzqScj8JsMDqmWPYbl7daVhmLg2cCJ0N9zJUGaiii6PqiPYIkXNRepdjE7wqe4r1v28uiXY1PVWwcgrGGyMMPapf_LRMNthQg-G360jxr3NxQHTocBhWkSl5unCWKeNO1p0 May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 25dba82031df4b04a81213933bddf78e May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-VolumesNegativeTest-1587487283 May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:31:37.198087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:31:37.199297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/25dba82031df4b04a81213933bddf78e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/25dba82031df4b04a81213933bddf78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_25dba82031df4b04a81213933bddf78e", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/25dba82031df4b04a81213933bddf78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:31:37.199297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-VolumesNegativeTest-1587487283 May 12 14:31:37.199297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 25dba82031df4b04a81213933bddf78e May 12 14:31:37.199297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-VolumesNegativeTest-1587487283 May 12 14:31:37.199297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-VolumesNegativeTest-1587487283-project May 12 14:31:37.199297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:31:37.199297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:31:37.199297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: bd29830540b64091bdbafd09000e0813 May 12 14:31:37.199297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-VolumesNegativeTest-1587487283-project May 12 14:31:37.199297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: May 12 14:31:37.199297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1895519675", "metadata": {"Type": "work"}}} May 12 14:31:37.199297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: May 12 14:31:37.199297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1895519675', 'metadata': {'Type': 'work'}}}} May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise error May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi '0' May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:31:37.199955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 14:31:37.201278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 14:31:37.202238 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 14:31:37.202238 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:37.204661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7fee105a-27f4-41cc-8e91-f262d6cf4c69 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:31:37.208425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7fee105a-27f4-41cc-8e91-f262d6cf4c69 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020887 May 12 14:31:37.210393 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 27/42] 10.222.0.75 () {60 vars in 1155 bytes} [Thu May 12 14:31:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 14:31:37.494055 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-a56f2101-7b55-4ced-b5c3-4e7c0368b482 req-0519ee5a-aa12-4c42-b66e-5827d94953fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b422890a-65ed-4ca3-b19c-ec9fbba5e813", "tag": "5c15b5e9-eb16-450c-b4f2-aaddb6302fe6"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:31:37.550440 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-a56f2101-7b55-4ced-b5c3-4e7c0368b482 req-0519ee5a-aa12-4c42-b66e-5827d94953fc service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:37.553270 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-a56f2101-7b55-4ced-b5c3-4e7c0368b482 req-0519ee5a-aa12-4c42-b66e-5827d94953fc service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:37.569998 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Flavor limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:31:37.570509 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Image limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:31:37.570902 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Flavor pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:31:37.571343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Image pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:31:37.571759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:31:37.596488 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:37.608885 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:37.609926 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:37.610387 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:37.614468 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-a56f2101-7b55-4ced-b5c3-4e7c0368b482 req-0519ee5a-aa12-4c42-b66e-5827d94953fc service nova] Creating event network-changed:5c15b5e9-eb16-450c-b4f2-aaddb6302fe6 for instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 on hv-cinder-77703 May 12 14:31:37.615445 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-a56f2101-7b55-4ced-b5c3-4e7c0368b482 req-0519ee5a-aa12-4c42-b66e-5827d94953fc service nova] Acquired lock "compute-rpcapi-router" {{(pid=118216) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 14:31:37.618657 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-42dfd39f-8f9a-46e5-a40c-593f8cad39b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:37.620476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-42dfd39f-8f9a-46e5-a40c-593f8cad39b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:37.621453 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-42dfd39f-8f9a-46e5-a40c-593f8cad39b2 None None] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:37.622509 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-42dfd39f-8f9a-46e5-a40c-593f8cad39b2 None None] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:37.640566 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.compute.rpcapi [None req-42dfd39f-8f9a-46e5-a40c-593f8cad39b2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 14:31:37.643463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-42dfd39f-8f9a-46e5-a40c-593f8cad39b2 None None] Releasing lock "compute-rpcapi-router" {{(pid=118216) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 14:31:37.647498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Getting quotas for project 202791457f0749649e8cc096f6e43404. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:31:37.674195 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Getting quotas for user c3b76edcb338405a9bf2f68e91dfacdd and project 202791457f0749649e8cc096f6e43404. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:31:37.677031 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-42dfd39f-8f9a-46e5-a40c-593f8cad39b2 None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.464562 May 12 14:31:37.677933 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 28/43] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:31:37.685912 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6622e180-480b-4168-8721-1dd6891af520 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:37.686675 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6622e180-480b-4168-8721-1dd6891af520 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:37.701897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6622e180-480b-4168-8721-1dd6891af520 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:37.702616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6622e180-480b-4168-8721-1dd6891af520 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:37.705006 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6622e180-480b-4168-8721-1dd6891af520 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:37.705655 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6622e180-480b-4168-8721-1dd6891af520 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:37.716697 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Going to run 1 instances... {{(pid=118217) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:31:37.724829 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:31:37.868288 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a2ce50c2-f07e-4fa7-8cb2-2a588925f7f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.503252 May 12 14:31:37.870583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 16/44] 10.222.0.75 () {62 vars in 1187 bytes} [Thu May 12 14:31:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 14:31:37.875987 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a21a2486-8222-4dad-8ed1-1eaf00512487 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:37.876820 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a21a2486-8222-4dad-8ed1-1eaf00512487 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:37.953546 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6622e180-480b-4168-8721-1dd6891af520 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:37.974113 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6622e180-480b-4168-8721-1dd6891af520 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.294804 May 12 14:31:37.980156 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 29/45] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:37 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:38.003565 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ed505a0c-2979-40c3-a595-84887fbb3da1 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Action: 'create', calling method: .version_select at 0x7f5b27d29280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1918982976", "metadata": {"Type": "work"}}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ed505a0c-2979-40c3-a595-84887fbb3da1 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Request method failure captured: May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 119 May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRpHZb3BW_Wk-FcJ4AaxVPw6bFWnGRbdrQZaT1SDLBn2rzqScj8JsMDqmWPYbl7daVhmLg2cCJ0N9zJUGaiii6PqiPYIkXNRepdjE7wqe4r1v28uiXY1PVWwcgrGGyMMPapf_LRMNthQg-G360jxr3NxQHTocBhWkSl5unCWKeNO1p0 May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 25dba82031df4b04a81213933bddf78e May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-VolumesNegativeTest-1587487283 May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:31:38.010714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:31:38.011881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/25dba82031df4b04a81213933bddf78e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/25dba82031df4b04a81213933bddf78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_25dba82031df4b04a81213933bddf78e", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/25dba82031df4b04a81213933bddf78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:31:38.011881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-VolumesNegativeTest-1587487283 May 12 14:31:38.011881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 25dba82031df4b04a81213933bddf78e May 12 14:31:38.011881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-VolumesNegativeTest-1587487283 May 12 14:31:38.011881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-VolumesNegativeTest-1587487283-project May 12 14:31:38.011881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:31:38.011881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:31:38.011881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: bd29830540b64091bdbafd09000e0813 May 12 14:31:38.011881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-VolumesNegativeTest-1587487283-project May 12 14:31:38.011881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: May 12 14:31:38.011881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1918982976", "metadata": {"Type": "work"}}} May 12 14:31:38.011881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: May 12 14:31:38.011881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1918982976', 'metadata': {'Type': 'work'}}}} May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise error May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi '' May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:31:38.012567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 14:31:38.013661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 14:31:38.014565 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 14:31:38.014565 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:38.017738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ed505a0c-2979-40c3-a595-84887fbb3da1 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:31:38.018705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ed505a0c-2979-40c3-a595-84887fbb3da1 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.035449 May 12 14:31:38.027211 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 30/46] 10.222.0.75 () {60 vars in 1155 bytes} [Thu May 12 14:31:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 14:31:38.052592 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-bb2a2055-0970-4ca7-9e70-5ca9100e5085 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:38.053234 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-bb2a2055-0970-4ca7-9e70-5ca9100e5085 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:38.085372 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a21a2486-8222-4dad-8ed1-1eaf00512487 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:38.109149 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a21a2486-8222-4dad-8ed1-1eaf00512487 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1242 microversion: 2.1 time: 0.237166 May 12 14:31:38.111109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 17/47] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:37 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1242 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:38.116845 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-511dadd1-9a2e-475c-af16-2d211a47caf4 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Calling method '.version_select at 0x7f5b26d32f70>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:38.194016 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-511dadd1-9a2e-475c-af16-2d211a47caf4 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] HTTP exception thrown: Volume tempest-invalid-702910903 could not be found. May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-511dadd1-9a2e-475c-af16-2d211a47caf4 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Request method failure captured: May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-702910903 HTTP/1.1 May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRpHZb3BW_Wk-FcJ4AaxVPw6bFWnGRbdrQZaT1SDLBn2rzqScj8JsMDqmWPYbl7daVhmLg2cCJ0N9zJUGaiii6PqiPYIkXNRepdjE7wqe4r1v28uiXY1PVWwcgrGGyMMPapf_LRMNthQg-G360jxr3NxQHTocBhWkSl5unCWKeNO1p0 May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 25dba82031df4b04a81213933bddf78e May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-VolumesNegativeTest-1587487283 May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:31:38.196619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:31:38.197827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/25dba82031df4b04a81213933bddf78e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/25dba82031df4b04a81213933bddf78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_25dba82031df4b04a81213933bddf78e", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/25dba82031df4b04a81213933bddf78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:31:38.197827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-VolumesNegativeTest-1587487283 May 12 14:31:38.197827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 25dba82031df4b04a81213933bddf78e May 12 14:31:38.197827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-VolumesNegativeTest-1587487283 May 12 14:31:38.197827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-VolumesNegativeTest-1587487283-project May 12 14:31:38.197827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:31:38.197827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:31:38.197827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: bd29830540b64091bdbafd09000e0813 May 12 14:31:38.197827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-VolumesNegativeTest-1587487283-project May 12 14:31:38.197827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: May 12 14:31:38.197827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Volume tempest-invalid-702910903 could not be found. May 12 14:31:38.197827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': 'tempest-invalid-702910903'} May 12 14:31:38.197827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-702910903 could not be found. (HTTP 404) (Request-ID: req-1dabb93f-bfbe-4613-9786-4826ec6dfda4) May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:38.198622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 14:31:38.199859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-702910903 could not be found. May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:31:38.201446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-702910903 could not be found. May 12 14:31:38.202896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:38.202896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:38.202896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:38.202896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:38.202896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:38.202896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:38.202896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:31:38.202896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:31:38.202896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-702910903 could not be found. May 12 14:31:38.202896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:38.203521 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-bb2a2055-0970-4ca7-9e70-5ca9100e5085 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:38.204035 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-511dadd1-9a2e-475c-af16-2d211a47caf4 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Returning 404 to user: Volume tempest-invalid-702910903 could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:31:38.205165 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-511dadd1-9a2e-475c-af16-2d211a47caf4 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/tempest-invalid-702910903" status: 404 len: 98 microversion: 2.1 time: 0.092547 May 12 14:31:38.205273 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-bb2a2055-0970-4ca7-9e70-5ca9100e5085 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:38.205907 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 18/48] 10.222.0.75 () {58 vars in 1214 bytes} [Thu May 12 14:31:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-702910903 => generated 98 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 12 14:31:38.213719 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-bb2a2055-0970-4ca7-9e70-5ca9100e5085 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:38.217126 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-bb2a2055-0970-4ca7-9e70-5ca9100e5085 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1280 microversion: 2.20 time: 0.188608 May 12 14:31:38.229390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 31/49] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:38 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1280 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:38.239366 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-26648ab3-9a7d-46e9-9587-0c3350cf1f0f tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017604 May 12 14:31:38.241464 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 19/50] 10.222.0.75 () {58 vars in 1139 bytes} [Thu May 12 14:31:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 14:31:38.251427 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b45ad812-db0a-4bd6-97fe-77cf5bd46ac2 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004017 May 12 14:31:38.251917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 32/51] 10.222.0.75 () {58 vars in 1136 bytes} [Thu May 12 14:31:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 14:31:38.263210 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ea2f2b3a-5b33-4599-857c-a1a899957f20 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Calling method '.version_select at 0x7f5b26d20dc0>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:38.324678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-ea2f2b3a-5b33-4599-857c-a1a899957f20 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] HTTP exception thrown: Volume 5015657a-8a16-4ffd-8b74-c80df26f7dee could not be found. May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ea2f2b3a-5b33-4599-857c-a1a899957f20 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Request method failure captured: May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: DELETE /compute/v2.1/os-volumes/5015657a-8a16-4ffd-8b74-c80df26f7dee HTTP/1.1 May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRpHZb3BW_Wk-FcJ4AaxVPw6bFWnGRbdrQZaT1SDLBn2rzqScj8JsMDqmWPYbl7daVhmLg2cCJ0N9zJUGaiii6PqiPYIkXNRepdjE7wqe4r1v28uiXY1PVWwcgrGGyMMPapf_LRMNthQg-G360jxr3NxQHTocBhWkSl5unCWKeNO1p0 May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 25dba82031df4b04a81213933bddf78e May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-VolumesNegativeTest-1587487283 May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:31:38.326620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:31:38.327851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/25dba82031df4b04a81213933bddf78e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/25dba82031df4b04a81213933bddf78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_25dba82031df4b04a81213933bddf78e", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/25dba82031df4b04a81213933bddf78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:31:38.327851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-VolumesNegativeTest-1587487283 May 12 14:31:38.327851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 25dba82031df4b04a81213933bddf78e May 12 14:31:38.327851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-VolumesNegativeTest-1587487283 May 12 14:31:38.327851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-VolumesNegativeTest-1587487283-project May 12 14:31:38.327851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:31:38.327851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:31:38.327851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: bd29830540b64091bdbafd09000e0813 May 12 14:31:38.327851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-VolumesNegativeTest-1587487283-project May 12 14:31:38.327851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: May 12 14:31:38.327851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Volume 5015657a-8a16-4ffd-8b74-c80df26f7dee could not be found. May 12 14:31:38.327851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': '5015657a-8a16-4ffd-8b74-c80df26f7dee'} May 12 14:31:38.327851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5015657a-8a16-4ffd-8b74-c80df26f7dee could not be found. (HTTP 404) (Request-ID: req-b118bb72-bc80-40f8-8ba7-57bb6f212d9d) May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:38.328535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 14:31:38.329479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5015657a-8a16-4ffd-8b74-c80df26f7dee could not be found. May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 14:31:38.330497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:31:38.332021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5015657a-8a16-4ffd-8b74-c80df26f7dee could not be found. May 12 14:31:38.332021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:38.332021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:38.332021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:38.332021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:38.332021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:38.332021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:38.332021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:31:38.332021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:31:38.332021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5015657a-8a16-4ffd-8b74-c80df26f7dee could not be found. May 12 14:31:38.332021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:31:38.332021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ea2f2b3a-5b33-4599-857c-a1a899957f20 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Returning 404 to user: Volume 5015657a-8a16-4ffd-8b74-c80df26f7dee could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:31:38.332021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ea2f2b3a-5b33-4599-857c-a1a899957f20 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/5015657a-8a16-4ffd-8b74-c80df26f7dee" status: 404 len: 109 microversion: 2.1 time: 0.069939 May 12 14:31:38.332021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 20/52] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 12 14:31:38 2022] DELETE /compute/v2.1/os-volumes/5015657a-8a16-4ffd-8b74-c80df26f7dee => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:31:38.345331 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8a6866b6-26b4-4a2e-9796-d4d198434348 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Calling method '.version_select at 0x7f5b27d29ee0>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:38.390761 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-8a6866b6-26b4-4a2e-9796-d4d198434348 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] HTTP exception thrown: Volume 878ce1ba-457a-44b7-81b6-974a94119f6b could not be found. May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8a6866b6-26b4-4a2e-9796-d4d198434348 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Request method failure captured: May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/os-volumes/878ce1ba-457a-44b7-81b6-974a94119f6b HTTP/1.1 May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRpHZb3BW_Wk-FcJ4AaxVPw6bFWnGRbdrQZaT1SDLBn2rzqScj8JsMDqmWPYbl7daVhmLg2cCJ0N9zJUGaiii6PqiPYIkXNRepdjE7wqe4r1v28uiXY1PVWwcgrGGyMMPapf_LRMNthQg-G360jxr3NxQHTocBhWkSl5unCWKeNO1p0 May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 25dba82031df4b04a81213933bddf78e May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-VolumesNegativeTest-1587487283 May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:31:38.394044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:31:38.395747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/25dba82031df4b04a81213933bddf78e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/25dba82031df4b04a81213933bddf78e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_25dba82031df4b04a81213933bddf78e", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/25dba82031df4b04a81213933bddf78e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:31:38.395747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-VolumesNegativeTest-1587487283 May 12 14:31:38.395747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 25dba82031df4b04a81213933bddf78e May 12 14:31:38.395747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-VolumesNegativeTest-1587487283 May 12 14:31:38.395747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-VolumesNegativeTest-1587487283-project May 12 14:31:38.395747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:31:38.395747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:31:38.395747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: bd29830540b64091bdbafd09000e0813 May 12 14:31:38.395747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-VolumesNegativeTest-1587487283-project May 12 14:31:38.395747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: May 12 14:31:38.395747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Volume 878ce1ba-457a-44b7-81b6-974a94119f6b could not be found. May 12 14:31:38.395747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '878ce1ba-457a-44b7-81b6-974a94119f6b'} May 12 14:31:38.395747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 878ce1ba-457a-44b7-81b6-974a94119f6b could not be found. (HTTP 404) (Request-ID: req-27aeb2e9-5922-488a-9f6f-24716f7a3cc3) May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:38.396729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 14:31:38.397917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 878ce1ba-457a-44b7-81b6-974a94119f6b could not be found. May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 14:31:38.399098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:31:38.400255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 878ce1ba-457a-44b7-81b6-974a94119f6b could not be found. May 12 14:31:38.400255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:38.400255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:31:38.400255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:38.400255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:31:38.400255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:31:38.400255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:31:38.400255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:31:38.400255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:31:38.400255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 878ce1ba-457a-44b7-81b6-974a94119f6b could not be found. May 12 14:31:38.400255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:31:38.402380 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8a6866b6-26b4-4a2e-9796-d4d198434348 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] Returning 404 to user: Volume 878ce1ba-457a-44b7-81b6-974a94119f6b could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:31:38.403685 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8a6866b6-26b4-4a2e-9796-d4d198434348 tempest-VolumesNegativeTest-1587487283 tempest-VolumesNegativeTest-1587487283-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/878ce1ba-457a-44b7-81b6-974a94119f6b" status: 404 len: 109 microversion: 2.1 time: 0.066211 May 12 14:31:38.404408 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 33/53] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 12 14:31:38 2022] GET /compute/v2.1/os-volumes/878ce1ba-457a-44b7-81b6-974a94119f6b => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:31:38.998955 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f26a33d9-2423-4db3-b6bd-65c18f7b341f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:39.000953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f26a33d9-2423-4db3-b6bd-65c18f7b341f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:39.020585 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f26a33d9-2423-4db3-b6bd-65c18f7b341f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:39.025962 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f26a33d9-2423-4db3-b6bd-65c18f7b341f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:39.027447 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f26a33d9-2423-4db3-b6bd-65c18f7b341f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:39.028199 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f26a33d9-2423-4db3-b6bd-65c18f7b341f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:39.129313 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a9f1ece9-21e1-48f6-a567-c9bd5cb907de tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:39.130272 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a9f1ece9-21e1-48f6-a567-c9bd5cb907de tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:39.143895 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9f1ece9-21e1-48f6-a567-c9bd5cb907de tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:39.144366 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9f1ece9-21e1-48f6-a567-c9bd5cb907de tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:39.145748 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9f1ece9-21e1-48f6-a567-c9bd5cb907de tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:39.146164 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9f1ece9-21e1-48f6-a567-c9bd5cb907de tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:39.248693 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a9f1ece9-21e1-48f6-a567-c9bd5cb907de tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:39.256719 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a9f1ece9-21e1-48f6-a567-c9bd5cb907de tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1246 microversion: 2.1 time: 0.132389 May 12 14:31:39.270255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 34/54] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:39 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1246 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:39.275280 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9f7dc7e7-b3b5-4d39-a94f-73ef926839c6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:39.275839 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9f7dc7e7-b3b5-4d39-a94f-73ef926839c6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:39.292043 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f7dc7e7-b3b5-4d39-a94f-73ef926839c6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:39.292516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f7dc7e7-b3b5-4d39-a94f-73ef926839c6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:39.293318 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f7dc7e7-b3b5-4d39-a94f-73ef926839c6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:39.293769 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f7dc7e7-b3b5-4d39-a94f-73ef926839c6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:39.303322 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f26a33d9-2423-4db3-b6bd-65c18f7b341f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:39.312690 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f26a33d9-2423-4db3-b6bd-65c18f7b341f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.320750 May 12 14:31:39.314125 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 21/55] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:38 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:39.395899 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9f7dc7e7-b3b5-4d39-a94f-73ef926839c6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:39.405525 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9f7dc7e7-b3b5-4d39-a94f-73ef926839c6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:39.407603 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9f7dc7e7-b3b5-4d39-a94f-73ef926839c6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:39.408999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9f7dc7e7-b3b5-4d39-a94f-73ef926839c6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1284 microversion: 2.20 time: 0.137680 May 12 14:31:39.409901 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 35/56] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:39 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:40.278304 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ee782891-6b96-4c4c-a130-147dc04436c4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:40.278949 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ee782891-6b96-4c4c-a130-147dc04436c4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:40.293905 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ee782891-6b96-4c4c-a130-147dc04436c4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:40.294378 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ee782891-6b96-4c4c-a130-147dc04436c4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:40.295209 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ee782891-6b96-4c4c-a130-147dc04436c4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:40.310738 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ee782891-6b96-4c4c-a130-147dc04436c4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:40.332324 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a049f506-ccb4-4197-ba71-4705d6bdd29b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:40.333683 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a049f506-ccb4-4197-ba71-4705d6bdd29b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:40.342146 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a049f506-ccb4-4197-ba71-4705d6bdd29b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:40.342998 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a049f506-ccb4-4197-ba71-4705d6bdd29b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:40.344245 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a049f506-ccb4-4197-ba71-4705d6bdd29b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:40.345206 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a049f506-ccb4-4197-ba71-4705d6bdd29b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:40.471251 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ee782891-6b96-4c4c-a130-147dc04436c4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:40.487221 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ee782891-6b96-4c4c-a130-147dc04436c4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1246 microversion: 2.1 time: 0.213606 May 12 14:31:40.487991 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 22/57] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:40 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1246 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:40.494834 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ea42a3c7-1cc2-41c5-80fe-1bb2ed60537c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:40.495700 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ea42a3c7-1cc2-41c5-80fe-1bb2ed60537c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:40.511056 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ea42a3c7-1cc2-41c5-80fe-1bb2ed60537c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:40.511896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ea42a3c7-1cc2-41c5-80fe-1bb2ed60537c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:40.512912 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ea42a3c7-1cc2-41c5-80fe-1bb2ed60537c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:40.513758 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ea42a3c7-1cc2-41c5-80fe-1bb2ed60537c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:40.591691 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a049f506-ccb4-4197-ba71-4705d6bdd29b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:40.601345 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a049f506-ccb4-4197-ba71-4705d6bdd29b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.274034 May 12 14:31:40.601935 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 36/58] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:40 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:31:40.649063 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ea42a3c7-1cc2-41c5-80fe-1bb2ed60537c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:40.664047 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ea42a3c7-1cc2-41c5-80fe-1bb2ed60537c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:40.665922 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ea42a3c7-1cc2-41c5-80fe-1bb2ed60537c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:40.667116 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ea42a3c7-1cc2-41c5-80fe-1bb2ed60537c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1284 microversion: 2.20 time: 0.177853 May 12 14:31:40.667686 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 23/59] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:40 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:41.508296 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ad131e68-b883-4894-bc62-b910ca93c4f4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:41.510698 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ad131e68-b883-4894-bc62-b910ca93c4f4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:41.519452 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ad131e68-b883-4894-bc62-b910ca93c4f4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:41.520788 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ad131e68-b883-4894-bc62-b910ca93c4f4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:41.521910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ad131e68-b883-4894-bc62-b910ca93c4f4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:41.522433 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ad131e68-b883-4894-bc62-b910ca93c4f4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:41.589285 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ad131e68-b883-4894-bc62-b910ca93c4f4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:41.596943 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ad131e68-b883-4894-bc62-b910ca93c4f4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1246 microversion: 2.1 time: 0.096501 May 12 14:31:41.606536 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 37/60] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:41 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1246 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:41.618751 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-33eeb70d-4e2c-4cd0-b170-62dd4f952517 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:41.619491 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-33eeb70d-4e2c-4cd0-b170-62dd4f952517 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:41.626294 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33eeb70d-4e2c-4cd0-b170-62dd4f952517 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:41.630355 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33eeb70d-4e2c-4cd0-b170-62dd4f952517 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:41.631239 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33eeb70d-4e2c-4cd0-b170-62dd4f952517 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:41.632438 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33eeb70d-4e2c-4cd0-b170-62dd4f952517 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:41.686119 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-868b9da2-c0cf-4f18-8412-1d4350669311 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:41.686685 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-868b9da2-c0cf-4f18-8412-1d4350669311 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:41.711224 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-868b9da2-c0cf-4f18-8412-1d4350669311 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:41.717879 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-868b9da2-c0cf-4f18-8412-1d4350669311 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:41.719974 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-868b9da2-c0cf-4f18-8412-1d4350669311 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:41.720441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-868b9da2-c0cf-4f18-8412-1d4350669311 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:41.800394 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-868b9da2-c0cf-4f18-8412-1d4350669311 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:41.813571 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-868b9da2-c0cf-4f18-8412-1d4350669311 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:41.815743 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-868b9da2-c0cf-4f18-8412-1d4350669311 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:41.827535 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-868b9da2-c0cf-4f18-8412-1d4350669311 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1284 microversion: 2.20 time: 0.145512 May 12 14:31:41.831334 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 38/61] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:41 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:31:41.870559 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-33eeb70d-4e2c-4cd0-b170-62dd4f952517 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:41.882042 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-33eeb70d-4e2c-4cd0-b170-62dd4f952517 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.267241 May 12 14:31:41.895479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 24/62] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:41 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:42.613304 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-102a5120-3070-4b36-97d3-6b1f26b043cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:42.614351 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-102a5120-3070-4b36-97d3-6b1f26b043cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:42.623598 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-102a5120-3070-4b36-97d3-6b1f26b043cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:42.624690 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-102a5120-3070-4b36-97d3-6b1f26b043cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:42.628289 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-102a5120-3070-4b36-97d3-6b1f26b043cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:42.629965 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-102a5120-3070-4b36-97d3-6b1f26b043cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:42.713585 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-102a5120-3070-4b36-97d3-6b1f26b043cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:42.721649 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-102a5120-3070-4b36-97d3-6b1f26b043cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1246 microversion: 2.1 time: 0.112416 May 12 14:31:42.724665 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 39/63] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:42 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1246 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:42.854358 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4ae7d9f2-aeb1-4bf6-b42a-c652c88445ed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:42.854358 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4ae7d9f2-aeb1-4bf6-b42a-c652c88445ed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:42.889502 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4ae7d9f2-aeb1-4bf6-b42a-c652c88445ed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:42.890740 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4ae7d9f2-aeb1-4bf6-b42a-c652c88445ed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:42.891485 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4ae7d9f2-aeb1-4bf6-b42a-c652c88445ed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:42.892271 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4ae7d9f2-aeb1-4bf6-b42a-c652c88445ed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:42.906100 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ec594c27-7e8e-4568-90ed-4997f152555b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:42.906100 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ec594c27-7e8e-4568-90ed-4997f152555b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:42.956159 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec594c27-7e8e-4568-90ed-4997f152555b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:42.957007 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec594c27-7e8e-4568-90ed-4997f152555b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:42.973475 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec594c27-7e8e-4568-90ed-4997f152555b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:42.976011 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec594c27-7e8e-4568-90ed-4997f152555b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:43.141268 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4ae7d9f2-aeb1-4bf6-b42a-c652c88445ed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:43.153328 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4ae7d9f2-aeb1-4bf6-b42a-c652c88445ed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:43.157234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4ae7d9f2-aeb1-4bf6-b42a-c652c88445ed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:43.158447 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4ae7d9f2-aeb1-4bf6-b42a-c652c88445ed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1284 microversion: 2.20 time: 0.314325 May 12 14:31:43.178134 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 25/64] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:42 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1284 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:43.355581 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ec594c27-7e8e-4568-90ed-4997f152555b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:43.364644 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ec594c27-7e8e-4568-90ed-4997f152555b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.467062 May 12 14:31:43.365492 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 40/65] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:42 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:43.743725 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3a09a9d7-38bd-4db9-987d-9c9ce9ce62ed tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:43.744378 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3a09a9d7-38bd-4db9-987d-9c9ce9ce62ed tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:43.751072 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3a09a9d7-38bd-4db9-987d-9c9ce9ce62ed tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:43.751544 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3a09a9d7-38bd-4db9-987d-9c9ce9ce62ed tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:43.752350 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3a09a9d7-38bd-4db9-987d-9c9ce9ce62ed tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:43.752802 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3a09a9d7-38bd-4db9-987d-9c9ce9ce62ed tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:43.884958 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3a09a9d7-38bd-4db9-987d-9c9ce9ce62ed tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:43.898219 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3a09a9d7-38bd-4db9-987d-9c9ce9ce62ed tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1246 microversion: 2.1 time: 0.159694 May 12 14:31:43.899858 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 26/66] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:43 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1246 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:44.188603 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d8a6a187-c55c-4350-8346-aaaba76b4aa0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:44.190133 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d8a6a187-c55c-4350-8346-aaaba76b4aa0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:44.203375 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d8a6a187-c55c-4350-8346-aaaba76b4aa0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:44.203878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d8a6a187-c55c-4350-8346-aaaba76b4aa0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:44.205271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d8a6a187-c55c-4350-8346-aaaba76b4aa0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:44.205874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d8a6a187-c55c-4350-8346-aaaba76b4aa0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:44.318543 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d8a6a187-c55c-4350-8346-aaaba76b4aa0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:44.330270 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d8a6a187-c55c-4350-8346-aaaba76b4aa0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:44.331759 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d8a6a187-c55c-4350-8346-aaaba76b4aa0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:44.333428 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d8a6a187-c55c-4350-8346-aaaba76b4aa0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1284 microversion: 2.20 time: 0.150730 May 12 14:31:44.337629 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 41/67] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:44 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:44.389390 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f228212e-e691-4b7c-92c3-8618d6372937 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:44.390987 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f228212e-e691-4b7c-92c3-8618d6372937 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:44.400027 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f228212e-e691-4b7c-92c3-8618d6372937 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:44.400734 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f228212e-e691-4b7c-92c3-8618d6372937 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:44.401527 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f228212e-e691-4b7c-92c3-8618d6372937 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:44.401973 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f228212e-e691-4b7c-92c3-8618d6372937 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:44.565747 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f228212e-e691-4b7c-92c3-8618d6372937 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:44.576895 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f228212e-e691-4b7c-92c3-8618d6372937 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.198712 May 12 14:31:44.579444 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 27/68] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:44 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:44.916453 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a9f7fc27-e9bb-4f45-b4a0-c6e4ef042881 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:44.917072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a9f7fc27-e9bb-4f45-b4a0-c6e4ef042881 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:44.925729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9f7fc27-e9bb-4f45-b4a0-c6e4ef042881 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:44.926699 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9f7fc27-e9bb-4f45-b4a0-c6e4ef042881 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:44.927971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9f7fc27-e9bb-4f45-b4a0-c6e4ef042881 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:44.928465 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9f7fc27-e9bb-4f45-b4a0-c6e4ef042881 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:45.022153 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a9f7fc27-e9bb-4f45-b4a0-c6e4ef042881 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:45.029598 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a9f7fc27-e9bb-4f45-b4a0-c6e4ef042881 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1246 microversion: 2.1 time: 0.116924 May 12 14:31:45.030169 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 42/69] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:44 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1246 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:45.354344 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d934c92f-bc47-48a4-a249-42b887377770 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:45.355063 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d934c92f-bc47-48a4-a249-42b887377770 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:45.361258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d934c92f-bc47-48a4-a249-42b887377770 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:45.362109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d934c92f-bc47-48a4-a249-42b887377770 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:45.363636 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d934c92f-bc47-48a4-a249-42b887377770 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:45.364267 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d934c92f-bc47-48a4-a249-42b887377770 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:45.442454 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d934c92f-bc47-48a4-a249-42b887377770 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:45.451485 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d934c92f-bc47-48a4-a249-42b887377770 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:45.453252 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d934c92f-bc47-48a4-a249-42b887377770 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:45.454398 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d934c92f-bc47-48a4-a249-42b887377770 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1284 microversion: 2.20 time: 0.104040 May 12 14:31:45.454955 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 28/70] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:45 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:31:45.602306 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-50ed8881-329e-4cf2-8af0-ffc63d385137 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:45.604643 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-50ed8881-329e-4cf2-8af0-ffc63d385137 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:45.614303 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-50ed8881-329e-4cf2-8af0-ffc63d385137 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:45.614803 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-50ed8881-329e-4cf2-8af0-ffc63d385137 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:45.615661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-50ed8881-329e-4cf2-8af0-ffc63d385137 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:45.616140 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-50ed8881-329e-4cf2-8af0-ffc63d385137 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:45.776156 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-50ed8881-329e-4cf2-8af0-ffc63d385137 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:45.786181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-50ed8881-329e-4cf2-8af0-ffc63d385137 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.196074 May 12 14:31:45.787234 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 43/71] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:45 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:46.047681 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ef9d9fa7-af89-488d-a8a8-459b2eef4996 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:46.048654 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ef9d9fa7-af89-488d-a8a8-459b2eef4996 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:46.055863 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ef9d9fa7-af89-488d-a8a8-459b2eef4996 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:46.056406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ef9d9fa7-af89-488d-a8a8-459b2eef4996 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:46.057349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ef9d9fa7-af89-488d-a8a8-459b2eef4996 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:46.058028 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ef9d9fa7-af89-488d-a8a8-459b2eef4996 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:46.146587 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ef9d9fa7-af89-488d-a8a8-459b2eef4996 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:46.153830 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ef9d9fa7-af89-488d-a8a8-459b2eef4996 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1246 microversion: 2.1 time: 0.110073 May 12 14:31:46.154547 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 29/72] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:46 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1246 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:46.472592 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c2af4227-ff2f-470a-b6a0-85042f094a3b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:46.474290 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c2af4227-ff2f-470a-b6a0-85042f094a3b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:46.480226 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c2af4227-ff2f-470a-b6a0-85042f094a3b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:46.480683 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c2af4227-ff2f-470a-b6a0-85042f094a3b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:46.481466 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c2af4227-ff2f-470a-b6a0-85042f094a3b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:46.482084 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c2af4227-ff2f-470a-b6a0-85042f094a3b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:46.545230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c2af4227-ff2f-470a-b6a0-85042f094a3b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:46.553943 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c2af4227-ff2f-470a-b6a0-85042f094a3b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:46.555516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c2af4227-ff2f-470a-b6a0-85042f094a3b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:46.556643 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c2af4227-ff2f-470a-b6a0-85042f094a3b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1284 microversion: 2.20 time: 0.087948 May 12 14:31:46.557206 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 44/73] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:46 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:46.802943 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bd2a63a3-661e-488b-a3db-8c07319295b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:46.803882 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bd2a63a3-661e-488b-a3db-8c07319295b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:46.810025 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bd2a63a3-661e-488b-a3db-8c07319295b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:46.810728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bd2a63a3-661e-488b-a3db-8c07319295b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:46.811619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bd2a63a3-661e-488b-a3db-8c07319295b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:46.812156 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bd2a63a3-661e-488b-a3db-8c07319295b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:46.977733 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bd2a63a3-661e-488b-a3db-8c07319295b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:46.986048 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bd2a63a3-661e-488b-a3db-8c07319295b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.186846 May 12 14:31:46.986786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 30/74] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:46 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:47.178942 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-09eecd2c-087a-4bb2-9a35-e031bc7f6f82 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:47.183656 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-09eecd2c-087a-4bb2-9a35-e031bc7f6f82 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:47.189728 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-09eecd2c-087a-4bb2-9a35-e031bc7f6f82 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:47.192285 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-09eecd2c-087a-4bb2-9a35-e031bc7f6f82 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:47.193165 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-09eecd2c-087a-4bb2-9a35-e031bc7f6f82 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:47.193674 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-09eecd2c-087a-4bb2-9a35-e031bc7f6f82 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:47.273999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-09eecd2c-087a-4bb2-9a35-e031bc7f6f82 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:47.283200 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-09eecd2c-087a-4bb2-9a35-e031bc7f6f82 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1246 microversion: 2.1 time: 0.116098 May 12 14:31:47.283766 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 45/75] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:47 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1246 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:47.580782 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bd684a8d-9658-46be-8a99-db995f5a34bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:47.581404 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bd684a8d-9658-46be-8a99-db995f5a34bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:47.587927 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bd684a8d-9658-46be-8a99-db995f5a34bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:47.588488 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bd684a8d-9658-46be-8a99-db995f5a34bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:47.589515 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bd684a8d-9658-46be-8a99-db995f5a34bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:47.590047 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bd684a8d-9658-46be-8a99-db995f5a34bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:47.664909 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bd684a8d-9658-46be-8a99-db995f5a34bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:47.680226 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bd684a8d-9658-46be-8a99-db995f5a34bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:47.682773 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bd684a8d-9658-46be-8a99-db995f5a34bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:47.685732 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bd684a8d-9658-46be-8a99-db995f5a34bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1284 microversion: 2.20 time: 0.114839 May 12 14:31:47.695102 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 31/76] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:47 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:48.002995 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e33bd236-ab74-4956-919a-b2011607e499 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:48.003762 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e33bd236-ab74-4956-919a-b2011607e499 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:48.010139 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e33bd236-ab74-4956-919a-b2011607e499 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:48.010604 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e33bd236-ab74-4956-919a-b2011607e499 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:48.011413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e33bd236-ab74-4956-919a-b2011607e499 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:48.011905 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e33bd236-ab74-4956-919a-b2011607e499 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:48.148384 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e33bd236-ab74-4956-919a-b2011607e499 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:48.155869 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e33bd236-ab74-4956-919a-b2011607e499 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.156850 May 12 14:31:48.156524 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 46/77] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:47 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:48.300048 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b655184a-2201-4536-86e5-8e48db86cee9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:48.300690 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b655184a-2201-4536-86e5-8e48db86cee9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:48.306418 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b655184a-2201-4536-86e5-8e48db86cee9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:48.306875 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b655184a-2201-4536-86e5-8e48db86cee9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:48.307684 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b655184a-2201-4536-86e5-8e48db86cee9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:48.308182 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b655184a-2201-4536-86e5-8e48db86cee9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:48.371061 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b655184a-2201-4536-86e5-8e48db86cee9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:48.378367 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b655184a-2201-4536-86e5-8e48db86cee9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1246 microversion: 2.1 time: 0.082220 May 12 14:31:48.379729 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 32/78] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:48 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:48.708677 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-777d01ad-1731-406a-9547-31e48878cfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:48.709305 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-777d01ad-1731-406a-9547-31e48878cfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:48.715487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-777d01ad-1731-406a-9547-31e48878cfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:48.716151 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-777d01ad-1731-406a-9547-31e48878cfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:48.716949 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-777d01ad-1731-406a-9547-31e48878cfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:48.717399 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-777d01ad-1731-406a-9547-31e48878cfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:48.824060 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-777d01ad-1731-406a-9547-31e48878cfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:48.834226 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-777d01ad-1731-406a-9547-31e48878cfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:48.835669 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-777d01ad-1731-406a-9547-31e48878cfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:48.836794 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-777d01ad-1731-406a-9547-31e48878cfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1284 microversion: 2.20 time: 0.132590 May 12 14:31:48.837359 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 47/79] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:48 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:49.173124 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c4e2e14e-6117-4072-b899-5b53bc0e22ae tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:49.173745 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c4e2e14e-6117-4072-b899-5b53bc0e22ae tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:49.180323 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c4e2e14e-6117-4072-b899-5b53bc0e22ae tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:49.180788 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c4e2e14e-6117-4072-b899-5b53bc0e22ae tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:49.181571 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c4e2e14e-6117-4072-b899-5b53bc0e22ae tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:49.182017 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c4e2e14e-6117-4072-b899-5b53bc0e22ae tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:49.386919 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c4e2e14e-6117-4072-b899-5b53bc0e22ae tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:49.395449 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f46bbb39-3a68-4bc6-ba64-66be9afdbc47 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:49.396160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f46bbb39-3a68-4bc6-ba64-66be9afdbc47 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:49.396285 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c4e2e14e-6117-4072-b899-5b53bc0e22ae tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.226944 May 12 14:31:49.396822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 33/80] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:49 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:49.402360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f46bbb39-3a68-4bc6-ba64-66be9afdbc47 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:49.402898 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f46bbb39-3a68-4bc6-ba64-66be9afdbc47 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:49.403805 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f46bbb39-3a68-4bc6-ba64-66be9afdbc47 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:49.404337 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f46bbb39-3a68-4bc6-ba64-66be9afdbc47 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:49.516221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f46bbb39-3a68-4bc6-ba64-66be9afdbc47 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:49.525295 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f46bbb39-3a68-4bc6-ba64-66be9afdbc47 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1294 microversion: 2.1 time: 0.133564 May 12 14:31:49.526283 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 48/81] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:49 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1294 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:49.855699 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ff92b094-2f19-4e36-9313-9f48cb8f6645 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:49.856858 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ff92b094-2f19-4e36-9313-9f48cb8f6645 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:49.862627 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ff92b094-2f19-4e36-9313-9f48cb8f6645 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:49.863262 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ff92b094-2f19-4e36-9313-9f48cb8f6645 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:49.864115 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ff92b094-2f19-4e36-9313-9f48cb8f6645 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:49.864633 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ff92b094-2f19-4e36-9313-9f48cb8f6645 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:49.933631 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ff92b094-2f19-4e36-9313-9f48cb8f6645 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:49.943477 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ff92b094-2f19-4e36-9313-9f48cb8f6645 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:49.945053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ff92b094-2f19-4e36-9313-9f48cb8f6645 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:49.946217 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ff92b094-2f19-4e36-9313-9f48cb8f6645 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1332 microversion: 2.20 time: 0.095208 May 12 14:31:49.946779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 34/82] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:49 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:50.416866 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b9586e49-a0a5-4579-80eb-3e367b450a90 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:50.417503 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b9586e49-a0a5-4579-80eb-3e367b450a90 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:50.426688 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b9586e49-a0a5-4579-80eb-3e367b450a90 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:50.427222 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b9586e49-a0a5-4579-80eb-3e367b450a90 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:50.428106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b9586e49-a0a5-4579-80eb-3e367b450a90 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:50.428604 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b9586e49-a0a5-4579-80eb-3e367b450a90 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:50.542915 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1e681ad7-847a-4648-b5da-cb38a6f2f8f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:50.544395 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1e681ad7-847a-4648-b5da-cb38a6f2f8f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:50.553636 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1e681ad7-847a-4648-b5da-cb38a6f2f8f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:50.555158 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1e681ad7-847a-4648-b5da-cb38a6f2f8f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:50.555971 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1e681ad7-847a-4648-b5da-cb38a6f2f8f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:50.556719 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1e681ad7-847a-4648-b5da-cb38a6f2f8f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:50.642039 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1e681ad7-847a-4648-b5da-cb38a6f2f8f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:50.650188 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1e681ad7-847a-4648-b5da-cb38a6f2f8f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1300 microversion: 2.1 time: 0.110992 May 12 14:31:50.650701 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 35/83] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:50 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:50.669294 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b9586e49-a0a5-4579-80eb-3e367b450a90 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:50.676683 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b9586e49-a0a5-4579-80eb-3e367b450a90 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.266686 May 12 14:31:50.677254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 49/84] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:50 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:50.969955 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5dfa2910-4a6f-497d-87d4-2ddc6fe2435e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:50.970982 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5dfa2910-4a6f-497d-87d4-2ddc6fe2435e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:50.986760 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5dfa2910-4a6f-497d-87d4-2ddc6fe2435e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:50.987254 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5dfa2910-4a6f-497d-87d4-2ddc6fe2435e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:50.988556 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5dfa2910-4a6f-497d-87d4-2ddc6fe2435e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:50.989010 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5dfa2910-4a6f-497d-87d4-2ddc6fe2435e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:51.139717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5dfa2910-4a6f-497d-87d4-2ddc6fe2435e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:51.152631 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5dfa2910-4a6f-497d-87d4-2ddc6fe2435e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:51.154784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5dfa2910-4a6f-497d-87d4-2ddc6fe2435e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:51.155907 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5dfa2910-4a6f-497d-87d4-2ddc6fe2435e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1338 microversion: 2.20 time: 0.191793 May 12 14:31:51.156668 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 36/85] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:50 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1338 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:51.667790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-cf3ea9df-f6bc-4e43-b97a-56e76074cca5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:51.668550 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-cf3ea9df-f6bc-4e43-b97a-56e76074cca5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:51.676202 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cf3ea9df-f6bc-4e43-b97a-56e76074cca5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:51.676650 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cf3ea9df-f6bc-4e43-b97a-56e76074cca5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:51.677440 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cf3ea9df-f6bc-4e43-b97a-56e76074cca5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:51.677877 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cf3ea9df-f6bc-4e43-b97a-56e76074cca5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:51.694031 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-05af3e20-7e51-4d33-8942-558616662b51 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:51.694788 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-05af3e20-7e51-4d33-8942-558616662b51 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:51.700942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-05af3e20-7e51-4d33-8942-558616662b51 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:51.701548 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-05af3e20-7e51-4d33-8942-558616662b51 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:51.702368 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-05af3e20-7e51-4d33-8942-558616662b51 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:51.703015 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-05af3e20-7e51-4d33-8942-558616662b51 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:52.060539 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-cf3ea9df-f6bc-4e43-b97a-56e76074cca5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:52.068564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-cf3ea9df-f6bc-4e43-b97a-56e76074cca5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.405318 May 12 14:31:52.069144 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 50/86] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:51 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:52.083458 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-05af3e20-7e51-4d33-8942-558616662b51 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:52.091207 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-05af3e20-7e51-4d33-8942-558616662b51 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.401716 May 12 14:31:52.100694 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 37/87] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:51 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:31:52.173714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-88e2277c-6f0c-42d2-bee4-3c86d28c7539 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:52.174344 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-88e2277c-6f0c-42d2-bee4-3c86d28c7539 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:52.180532 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-88e2277c-6f0c-42d2-bee4-3c86d28c7539 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:52.181005 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-88e2277c-6f0c-42d2-bee4-3c86d28c7539 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:52.181785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-88e2277c-6f0c-42d2-bee4-3c86d28c7539 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:52.182229 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-88e2277c-6f0c-42d2-bee4-3c86d28c7539 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:52.315531 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-88e2277c-6f0c-42d2-bee4-3c86d28c7539 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:52.324231 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-88e2277c-6f0c-42d2-bee4-3c86d28c7539 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:52.325830 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-88e2277c-6f0c-42d2-bee4-3c86d28c7539 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:52.327104 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-88e2277c-6f0c-42d2-bee4-3c86d28c7539 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.157294 May 12 14:31:52.327759 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 51/88] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:52 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:53.085360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a1173514-e117-4349-b581-ee5d4d2bf82e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:53.085980 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a1173514-e117-4349-b581-ee5d4d2bf82e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:53.091930 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a1173514-e117-4349-b581-ee5d4d2bf82e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:53.092395 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a1173514-e117-4349-b581-ee5d4d2bf82e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:53.093168 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a1173514-e117-4349-b581-ee5d4d2bf82e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:53.093614 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a1173514-e117-4349-b581-ee5d4d2bf82e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:53.108078 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c07e9b43-4de9-4829-8c37-0966b2dd0bbc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:53.109485 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c07e9b43-4de9-4829-8c37-0966b2dd0bbc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:53.116537 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c07e9b43-4de9-4829-8c37-0966b2dd0bbc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:53.117002 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c07e9b43-4de9-4829-8c37-0966b2dd0bbc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:53.117797 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c07e9b43-4de9-4829-8c37-0966b2dd0bbc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:53.118244 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c07e9b43-4de9-4829-8c37-0966b2dd0bbc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:53.290646 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a1173514-e117-4349-b581-ee5d4d2bf82e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:53.294497 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c07e9b43-4de9-4829-8c37-0966b2dd0bbc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:53.297942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a1173514-e117-4349-b581-ee5d4d2bf82e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.216476 May 12 14:31:53.298515 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 38/89] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:53 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:53.302273 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c07e9b43-4de9-4829-8c37-0966b2dd0bbc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.198266 May 12 14:31:53.302852 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 52/90] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:53 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:31:53.345349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a340e902-6c00-4e86-af5a-c909b9b9c44a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:53.345986 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a340e902-6c00-4e86-af5a-c909b9b9c44a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:53.352518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a340e902-6c00-4e86-af5a-c909b9b9c44a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:53.352971 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a340e902-6c00-4e86-af5a-c909b9b9c44a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:53.353740 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a340e902-6c00-4e86-af5a-c909b9b9c44a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:53.354176 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a340e902-6c00-4e86-af5a-c909b9b9c44a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:53.478774 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a340e902-6c00-4e86-af5a-c909b9b9c44a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:53.486448 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a340e902-6c00-4e86-af5a-c909b9b9c44a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:53.488009 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a340e902-6c00-4e86-af5a-c909b9b9c44a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:53.489111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a340e902-6c00-4e86-af5a-c909b9b9c44a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.147554 May 12 14:31:53.489670 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 39/91] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:53 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:54.314429 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-5051bb0b-b8e4-4b51-a433-f86803aa4c1e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:54.315057 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-5051bb0b-b8e4-4b51-a433-f86803aa4c1e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:54.318348 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-6f7efeb4-aa92-4451-a2a7-e34640e197bc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:54.318972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-6f7efeb4-aa92-4451-a2a7-e34640e197bc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:54.321626 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5051bb0b-b8e4-4b51-a433-f86803aa4c1e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:54.322028 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5051bb0b-b8e4-4b51-a433-f86803aa4c1e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:54.322807 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5051bb0b-b8e4-4b51-a433-f86803aa4c1e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:54.323277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5051bb0b-b8e4-4b51-a433-f86803aa4c1e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:54.324817 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6f7efeb4-aa92-4451-a2a7-e34640e197bc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:54.325276 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6f7efeb4-aa92-4451-a2a7-e34640e197bc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:54.326057 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6f7efeb4-aa92-4451-a2a7-e34640e197bc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:54.326504 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6f7efeb4-aa92-4451-a2a7-e34640e197bc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:54.506875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-5051bb0b-b8e4-4b51-a433-f86803aa4c1e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:54.516502 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-5051bb0b-b8e4-4b51-a433-f86803aa4c1e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.205747 May 12 14:31:54.517179 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 53/92] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:54 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:54.517979 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-6f7efeb4-aa92-4451-a2a7-e34640e197bc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:54.521517 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2baf48ae-981a-4358-b056-a8e4977fa59a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:54.522897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2baf48ae-981a-4358-b056-a8e4977fa59a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:54.526335 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-6f7efeb4-aa92-4451-a2a7-e34640e197bc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.212364 May 12 14:31:54.526935 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 40/93] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:54 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:31:54.530457 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2baf48ae-981a-4358-b056-a8e4977fa59a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:54.531022 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2baf48ae-981a-4358-b056-a8e4977fa59a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:54.531942 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2baf48ae-981a-4358-b056-a8e4977fa59a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:54.532478 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2baf48ae-981a-4358-b056-a8e4977fa59a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:54.669172 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2baf48ae-981a-4358-b056-a8e4977fa59a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:54.677094 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2baf48ae-981a-4358-b056-a8e4977fa59a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:54.678614 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2baf48ae-981a-4358-b056-a8e4977fa59a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:54.679756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2baf48ae-981a-4358-b056-a8e4977fa59a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.161743 May 12 14:31:54.680327 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 54/94] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:54 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:55.534221 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-36bfd146-f080-40ab-a470-91758600c92c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:55.534884 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-36bfd146-f080-40ab-a470-91758600c92c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:55.541791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-36bfd146-f080-40ab-a470-91758600c92c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:55.542249 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-36bfd146-f080-40ab-a470-91758600c92c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:55.543088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-36bfd146-f080-40ab-a470-91758600c92c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:55.543493 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-36bfd146-f080-40ab-a470-91758600c92c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:55.544853 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b743eabb-6bd6-405f-b04a-2e51f175d5dc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:55.545472 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b743eabb-6bd6-405f-b04a-2e51f175d5dc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:55.551950 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b743eabb-6bd6-405f-b04a-2e51f175d5dc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:55.552420 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b743eabb-6bd6-405f-b04a-2e51f175d5dc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:55.553254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b743eabb-6bd6-405f-b04a-2e51f175d5dc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:55.553714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b743eabb-6bd6-405f-b04a-2e51f175d5dc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:55.752792 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-36bfd146-f080-40ab-a470-91758600c92c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:55.759390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b743eabb-6bd6-405f-b04a-2e51f175d5dc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:55.762457 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-36bfd146-f080-40ab-a470-91758600c92c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.232114 May 12 14:31:55.763065 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 41/95] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:55 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:55.768611 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b19254ce-609f-450f-bf24-3dd7fd1edc39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:55.770136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b19254ce-609f-450f-bf24-3dd7fd1edc39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:55.777144 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b743eabb-6bd6-405f-b04a-2e51f175d5dc tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.236208 May 12 14:31:55.777273 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b19254ce-609f-450f-bf24-3dd7fd1edc39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:55.777591 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b19254ce-609f-450f-bf24-3dd7fd1edc39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:55.777885 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 55/96] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:55 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:31:55.787590 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b19254ce-609f-450f-bf24-3dd7fd1edc39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:55.788060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b19254ce-609f-450f-bf24-3dd7fd1edc39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:55.939057 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b19254ce-609f-450f-bf24-3dd7fd1edc39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:55.948151 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b19254ce-609f-450f-bf24-3dd7fd1edc39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:55.949779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b19254ce-609f-450f-bf24-3dd7fd1edc39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:55.950989 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b19254ce-609f-450f-bf24-3dd7fd1edc39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.186827 May 12 14:31:55.951928 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 42/97] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:55 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:56.779467 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-06cac55d-e01a-4307-ad25-e9c0c4b78ef2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:56.780090 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-06cac55d-e01a-4307-ad25-e9c0c4b78ef2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:56.786628 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-06cac55d-e01a-4307-ad25-e9c0c4b78ef2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:56.787114 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-06cac55d-e01a-4307-ad25-e9c0c4b78ef2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:56.787903 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-06cac55d-e01a-4307-ad25-e9c0c4b78ef2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:56.788344 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-06cac55d-e01a-4307-ad25-e9c0c4b78ef2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:56.795278 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8cc51e72-6b30-4179-942e-dd6598ad494d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:56.795278 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8cc51e72-6b30-4179-942e-dd6598ad494d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:56.801536 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8cc51e72-6b30-4179-942e-dd6598ad494d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:56.802077 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8cc51e72-6b30-4179-942e-dd6598ad494d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:56.802952 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8cc51e72-6b30-4179-942e-dd6598ad494d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:56.803527 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8cc51e72-6b30-4179-942e-dd6598ad494d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:57.000323 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-06cac55d-e01a-4307-ad25-e9c0c4b78ef2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:57.005260 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8cc51e72-6b30-4179-942e-dd6598ad494d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:57.018003 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-06cac55d-e01a-4307-ad25-e9c0c4b78ef2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.242342 May 12 14:31:57.020895 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8cc51e72-6b30-4179-942e-dd6598ad494d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.230369 May 12 14:31:57.031362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 56/98] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:56 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:57.031725 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 43/99] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:56 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:31:57.031946 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-29b13221-5667-486b-94eb-fc7bc6fce9ce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:57.031946 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-29b13221-5667-486b-94eb-fc7bc6fce9ce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:57.033277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-29b13221-5667-486b-94eb-fc7bc6fce9ce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:57.033810 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-29b13221-5667-486b-94eb-fc7bc6fce9ce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:57.034801 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-29b13221-5667-486b-94eb-fc7bc6fce9ce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:57.035959 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-29b13221-5667-486b-94eb-fc7bc6fce9ce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:57.179296 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-29b13221-5667-486b-94eb-fc7bc6fce9ce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:57.197523 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-29b13221-5667-486b-94eb-fc7bc6fce9ce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:57.197523 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-29b13221-5667-486b-94eb-fc7bc6fce9ce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:57.197523 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-29b13221-5667-486b-94eb-fc7bc6fce9ce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.168116 May 12 14:31:57.197971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 57/100] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:57 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:58.042256 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f5a653e7-dcda-4ace-9145-2fd68ffed660 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:58.042776 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f5a653e7-dcda-4ace-9145-2fd68ffed660 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:58.044037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0187d483-051d-4007-af1f-f5a9bed714f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:58.044718 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0187d483-051d-4007-af1f-f5a9bed714f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:58.049045 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f5a653e7-dcda-4ace-9145-2fd68ffed660 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:58.049508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f5a653e7-dcda-4ace-9145-2fd68ffed660 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:58.050782 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f5a653e7-dcda-4ace-9145-2fd68ffed660 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:58.051239 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0187d483-051d-4007-af1f-f5a9bed714f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:58.051339 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f5a653e7-dcda-4ace-9145-2fd68ffed660 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:58.051703 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0187d483-051d-4007-af1f-f5a9bed714f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:58.052521 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0187d483-051d-4007-af1f-f5a9bed714f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:58.052966 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0187d483-051d-4007-af1f-f5a9bed714f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:58.241408 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f5a653e7-dcda-4ace-9145-2fd68ffed660 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:58.244967 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0187d483-051d-4007-af1f-f5a9bed714f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:58.248631 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f5a653e7-dcda-4ace-9145-2fd68ffed660 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.210861 May 12 14:31:58.249207 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 44/101] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:58 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:58.252246 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0187d483-051d-4007-af1f-f5a9bed714f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.211895 May 12 14:31:58.252947 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 58/102] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:58 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:31:58.254266 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0f02ebe2-8016-42eb-a50c-447e200ca8f7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:58.254995 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0f02ebe2-8016-42eb-a50c-447e200ca8f7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:58.260993 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0f02ebe2-8016-42eb-a50c-447e200ca8f7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:58.261446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0f02ebe2-8016-42eb-a50c-447e200ca8f7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:58.262211 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0f02ebe2-8016-42eb-a50c-447e200ca8f7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:58.262643 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0f02ebe2-8016-42eb-a50c-447e200ca8f7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:58.388011 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0f02ebe2-8016-42eb-a50c-447e200ca8f7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:58.395892 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0f02ebe2-8016-42eb-a50c-447e200ca8f7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:58.397431 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0f02ebe2-8016-42eb-a50c-447e200ca8f7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:58.398545 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0f02ebe2-8016-42eb-a50c-447e200ca8f7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.148418 May 12 14:31:58.399143 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 45/103] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:58 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:31:59.266047 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b4a47f9a-3dd7-4a30-bd9e-6e4345b4fb61 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:59.266582 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b4a47f9a-3dd7-4a30-bd9e-6e4345b4fb61 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:59.268721 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c0b1ce3a-996d-433c-8f4a-7a0b5cd31f6d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:59.269870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c0b1ce3a-996d-433c-8f4a-7a0b5cd31f6d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:59.273105 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b4a47f9a-3dd7-4a30-bd9e-6e4345b4fb61 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:59.273557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b4a47f9a-3dd7-4a30-bd9e-6e4345b4fb61 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:59.274330 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b4a47f9a-3dd7-4a30-bd9e-6e4345b4fb61 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:59.274764 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b4a47f9a-3dd7-4a30-bd9e-6e4345b4fb61 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:59.275631 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c0b1ce3a-996d-433c-8f4a-7a0b5cd31f6d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:59.276088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c0b1ce3a-996d-433c-8f4a-7a0b5cd31f6d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:59.276864 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c0b1ce3a-996d-433c-8f4a-7a0b5cd31f6d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:59.277311 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c0b1ce3a-996d-433c-8f4a-7a0b5cd31f6d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:59.464579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b4a47f9a-3dd7-4a30-bd9e-6e4345b4fb61 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:59.470880 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c0b1ce3a-996d-433c-8f4a-7a0b5cd31f6d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:59.471847 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b4a47f9a-3dd7-4a30-bd9e-6e4345b4fb61 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.210026 May 12 14:31:59.472705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 59/104] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:59 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:31:59.477172 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4e33bf1e-c8b3-4a8f-bfb4-8eaee6a17509 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:31:59.477775 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4e33bf1e-c8b3-4a8f-bfb4-8eaee6a17509 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:31:59.478347 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c0b1ce3a-996d-433c-8f4a-7a0b5cd31f6d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.213446 May 12 14:31:59.478917 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 46/105] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:31:59 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:31:59.483500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4e33bf1e-c8b3-4a8f-bfb4-8eaee6a17509 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:59.483952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4e33bf1e-c8b3-4a8f-bfb4-8eaee6a17509 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:59.484722 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4e33bf1e-c8b3-4a8f-bfb4-8eaee6a17509 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:31:59.485154 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4e33bf1e-c8b3-4a8f-bfb4-8eaee6a17509 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:31:59.612870 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4e33bf1e-c8b3-4a8f-bfb4-8eaee6a17509 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:59.621418 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4e33bf1e-c8b3-4a8f-bfb4-8eaee6a17509 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:59.622936 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4e33bf1e-c8b3-4a8f-bfb4-8eaee6a17509 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:31:59.624092 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4e33bf1e-c8b3-4a8f-bfb4-8eaee6a17509 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.150438 May 12 14:31:59.624642 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 60/106] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:31:59 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:00.488894 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-534b6744-3034-4515-9a8b-248922f26a3e tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:00.489505 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-534b6744-3034-4515-9a8b-248922f26a3e tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:00.494769 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d34211f1-5657-44af-9676-d2644270cf93 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:00.495450 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-534b6744-3034-4515-9a8b-248922f26a3e tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:00.495567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d34211f1-5657-44af-9676-d2644270cf93 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:00.495900 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-534b6744-3034-4515-9a8b-248922f26a3e tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:00.496672 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-534b6744-3034-4515-9a8b-248922f26a3e tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:00.497111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-534b6744-3034-4515-9a8b-248922f26a3e tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:00.501611 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d34211f1-5657-44af-9676-d2644270cf93 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:00.502066 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d34211f1-5657-44af-9676-d2644270cf93 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:00.502836 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d34211f1-5657-44af-9676-d2644270cf93 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:00.503380 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d34211f1-5657-44af-9676-d2644270cf93 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:00.682117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-534b6744-3034-4515-9a8b-248922f26a3e tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:00.684897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d34211f1-5657-44af-9676-d2644270cf93 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:00.689525 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-534b6744-3034-4515-9a8b-248922f26a3e tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.205126 May 12 14:32:00.690179 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 47/107] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:00 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:00.692100 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d34211f1-5657-44af-9676-d2644270cf93 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.201106 May 12 14:32:00.694879 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1fd8e8d2-9db4-495a-89ff-0a53f6aceaa8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:00.695730 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1fd8e8d2-9db4-495a-89ff-0a53f6aceaa8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:00.697548 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 61/108] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:00 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:32:00.702622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1fd8e8d2-9db4-495a-89ff-0a53f6aceaa8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:00.703144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1fd8e8d2-9db4-495a-89ff-0a53f6aceaa8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:00.703915 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1fd8e8d2-9db4-495a-89ff-0a53f6aceaa8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:00.704353 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1fd8e8d2-9db4-495a-89ff-0a53f6aceaa8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:00.830976 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1fd8e8d2-9db4-495a-89ff-0a53f6aceaa8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:00.839180 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1fd8e8d2-9db4-495a-89ff-0a53f6aceaa8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:00.840697 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1fd8e8d2-9db4-495a-89ff-0a53f6aceaa8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:00.841794 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1fd8e8d2-9db4-495a-89ff-0a53f6aceaa8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.150623 May 12 14:32:00.842356 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 48/109] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:00 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:01.705671 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-daf3cdef-7961-409f-b32a-97cc9338071b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:01.706313 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-daf3cdef-7961-409f-b32a-97cc9338071b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:01.709059 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-86e4887e-8dae-4a2e-ae0e-80aac4d550e1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:01.709446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-86e4887e-8dae-4a2e-ae0e-80aac4d550e1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:01.712252 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-daf3cdef-7961-409f-b32a-97cc9338071b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:01.712704 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-daf3cdef-7961-409f-b32a-97cc9338071b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:01.713476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-daf3cdef-7961-409f-b32a-97cc9338071b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:01.713910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-daf3cdef-7961-409f-b32a-97cc9338071b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:01.715120 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-86e4887e-8dae-4a2e-ae0e-80aac4d550e1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:01.715584 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-86e4887e-8dae-4a2e-ae0e-80aac4d550e1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:01.716363 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-86e4887e-8dae-4a2e-ae0e-80aac4d550e1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:01.716806 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-86e4887e-8dae-4a2e-ae0e-80aac4d550e1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:02.092225 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-daf3cdef-7961-409f-b32a-97cc9338071b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:02.099326 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-86e4887e-8dae-4a2e-ae0e-80aac4d550e1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:02.099945 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-daf3cdef-7961-409f-b32a-97cc9338071b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.398284 May 12 14:32:02.100527 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 62/110] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:01 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:02.104926 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-78277b60-62a8-47b4-860e-fef78aa203f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:02.105536 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-78277b60-62a8-47b4-860e-fef78aa203f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:02.107266 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-86e4887e-8dae-4a2e-ae0e-80aac4d550e1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.402354 May 12 14:32:02.108499 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 49/111] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:01 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:32:02.112298 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-78277b60-62a8-47b4-860e-fef78aa203f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:02.113451 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-78277b60-62a8-47b4-860e-fef78aa203f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:02.114235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-78277b60-62a8-47b4-860e-fef78aa203f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:02.114675 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-78277b60-62a8-47b4-860e-fef78aa203f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:02.238216 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-78277b60-62a8-47b4-860e-fef78aa203f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:02.245890 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-78277b60-62a8-47b4-860e-fef78aa203f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:02.247428 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-78277b60-62a8-47b4-860e-fef78aa203f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:02.248535 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-78277b60-62a8-47b4-860e-fef78aa203f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.147090 May 12 14:32:02.249102 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 63/112] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:02 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:03.116434 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-13eee8f9-430e-483d-87b8-8050fb9e17e4 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:03.117065 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-13eee8f9-430e-483d-87b8-8050fb9e17e4 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:03.124072 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-13eee8f9-430e-483d-87b8-8050fb9e17e4 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:03.124684 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-13eee8f9-430e-483d-87b8-8050fb9e17e4 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:03.125632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-13eee8f9-430e-483d-87b8-8050fb9e17e4 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:03.126225 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-13eee8f9-430e-483d-87b8-8050fb9e17e4 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:03.127108 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e3b746d2-571d-4071-b920-9f32b617c2df tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:03.127981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e3b746d2-571d-4071-b920-9f32b617c2df tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:03.141036 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e3b746d2-571d-4071-b920-9f32b617c2df tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:03.141504 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e3b746d2-571d-4071-b920-9f32b617c2df tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:03.142304 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e3b746d2-571d-4071-b920-9f32b617c2df tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:03.144422 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e3b746d2-571d-4071-b920-9f32b617c2df tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:03.325668 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-13eee8f9-430e-483d-87b8-8050fb9e17e4 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:03.334441 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-13eee8f9-430e-483d-87b8-8050fb9e17e4 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.221722 May 12 14:32:03.335047 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 50/113] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:03 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:03.340308 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8ed9500d-796f-477e-92a6-3fcb643ff477 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:03.340868 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8ed9500d-796f-477e-92a6-3fcb643ff477 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:03.341042 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e3b746d2-571d-4071-b920-9f32b617c2df tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:03.347115 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8ed9500d-796f-477e-92a6-3fcb643ff477 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:03.347584 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8ed9500d-796f-477e-92a6-3fcb643ff477 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:03.348508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8ed9500d-796f-477e-92a6-3fcb643ff477 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:03.348862 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e3b746d2-571d-4071-b920-9f32b617c2df tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.227970 May 12 14:32:03.348967 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8ed9500d-796f-477e-92a6-3fcb643ff477 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:03.349443 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 64/114] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:03 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:03.482995 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8ed9500d-796f-477e-92a6-3fcb643ff477 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:03.491048 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8ed9500d-796f-477e-92a6-3fcb643ff477 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:03.492572 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8ed9500d-796f-477e-92a6-3fcb643ff477 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:03.493675 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8ed9500d-796f-477e-92a6-3fcb643ff477 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.157699 May 12 14:32:03.494248 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 51/115] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:03 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:04.351276 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ff585209-8776-4cc7-aedb-a825b82f1a47 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:04.352515 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ff585209-8776-4cc7-aedb-a825b82f1a47 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:04.366131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8ec8c00f-c459-4878-aa32-61fd3588e502 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:04.367666 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8ec8c00f-c459-4878-aa32-61fd3588e502 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:04.377462 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff585209-8776-4cc7-aedb-a825b82f1a47 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:04.377912 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff585209-8776-4cc7-aedb-a825b82f1a47 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:04.380527 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8ec8c00f-c459-4878-aa32-61fd3588e502 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:04.385861 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8ec8c00f-c459-4878-aa32-61fd3588e502 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:04.387281 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff585209-8776-4cc7-aedb-a825b82f1a47 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:04.387995 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff585209-8776-4cc7-aedb-a825b82f1a47 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:04.388304 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8ec8c00f-c459-4878-aa32-61fd3588e502 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:04.391869 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8ec8c00f-c459-4878-aa32-61fd3588e502 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:04.741876 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8ec8c00f-c459-4878-aa32-61fd3588e502 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:04.750708 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8ec8c00f-c459-4878-aa32-61fd3588e502 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.388147 May 12 14:32:04.752112 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 52/116] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:04 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:04.758460 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b23d5f8c-0b6e-4efb-8635-e735fa693f14 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:04.759218 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b23d5f8c-0b6e-4efb-8635-e735fa693f14 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:04.765653 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b23d5f8c-0b6e-4efb-8635-e735fa693f14 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:04.766048 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b23d5f8c-0b6e-4efb-8635-e735fa693f14 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:04.766823 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b23d5f8c-0b6e-4efb-8635-e735fa693f14 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:04.767448 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b23d5f8c-0b6e-4efb-8635-e735fa693f14 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:04.807340 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ff585209-8776-4cc7-aedb-a825b82f1a47 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:04.824405 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ff585209-8776-4cc7-aedb-a825b82f1a47 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.476892 May 12 14:32:04.825311 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 65/117] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:04 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:05.108432 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b23d5f8c-0b6e-4efb-8635-e735fa693f14 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:05.123780 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b23d5f8c-0b6e-4efb-8635-e735fa693f14 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:05.128820 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b23d5f8c-0b6e-4efb-8635-e735fa693f14 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:05.137579 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b23d5f8c-0b6e-4efb-8635-e735fa693f14 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.377109 May 12 14:32:05.138477 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 53/118] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:04 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:05.409381 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-1e5647c4-92be-460d-ba4c-9677c020e448 req-6f487fc1-79ce-4a9f-afdd-b5de2f4296e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fab0a31-9c59-40c0-8350-788bf0458078", "tag": "c3aac594-e895-4346-8c61-7bc47bc88813"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:32:05.423243 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-1e5647c4-92be-460d-ba4c-9677c020e448 req-6f487fc1-79ce-4a9f-afdd-b5de2f4296e1 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:05.423685 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-1e5647c4-92be-460d-ba4c-9677c020e448 req-6f487fc1-79ce-4a9f-afdd-b5de2f4296e1 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:05.493359 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-1e5647c4-92be-460d-ba4c-9677c020e448 req-6f487fc1-79ce-4a9f-afdd-b5de2f4296e1 service nova] Creating event network-changed:c3aac594-e895-4346-8c61-7bc47bc88813 for instance 1fab0a31-9c59-40c0-8350-788bf0458078 on hv-cinder-77703 May 12 14:32:05.508423 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-1e5647c4-92be-460d-ba4c-9677c020e448 req-6f487fc1-79ce-4a9f-afdd-b5de2f4296e1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103523 May 12 14:32:05.515445 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 66/119] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:32:05.778821 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-33c1473e-57c9-4146-b631-6eb6bc0c997b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:05.780839 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-33c1473e-57c9-4146-b631-6eb6bc0c997b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:05.792879 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33c1473e-57c9-4146-b631-6eb6bc0c997b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:05.793271 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33c1473e-57c9-4146-b631-6eb6bc0c997b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:05.794721 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33c1473e-57c9-4146-b631-6eb6bc0c997b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:05.795212 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33c1473e-57c9-4146-b631-6eb6bc0c997b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:05.842316 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-87203ba1-98d7-4a8d-a178-081a0a0e11af tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:05.843910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-87203ba1-98d7-4a8d-a178-081a0a0e11af tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:05.857078 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-87203ba1-98d7-4a8d-a178-081a0a0e11af tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:05.857617 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-87203ba1-98d7-4a8d-a178-081a0a0e11af tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:05.861270 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-87203ba1-98d7-4a8d-a178-081a0a0e11af tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:05.863362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-87203ba1-98d7-4a8d-a178-081a0a0e11af tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:06.077527 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-33c1473e-57c9-4146-b631-6eb6bc0c997b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:06.085509 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-33c1473e-57c9-4146-b631-6eb6bc0c997b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.320173 May 12 14:32:06.085998 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 54/120] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:05 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:32:06.120521 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-87203ba1-98d7-4a8d-a178-081a0a0e11af tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:06.129061 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-87203ba1-98d7-4a8d-a178-081a0a0e11af tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.291612 May 12 14:32:06.130392 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 67/121] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:05 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:06.155502 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-82c09139-0c06-4103-b7ea-919185a98bbc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:06.156376 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-82c09139-0c06-4103-b7ea-919185a98bbc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:06.177309 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-82c09139-0c06-4103-b7ea-919185a98bbc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:06.177863 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-82c09139-0c06-4103-b7ea-919185a98bbc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:06.178851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-82c09139-0c06-4103-b7ea-919185a98bbc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:06.179552 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-82c09139-0c06-4103-b7ea-919185a98bbc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:06.351926 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-82c09139-0c06-4103-b7ea-919185a98bbc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:06.360431 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-82c09139-0c06-4103-b7ea-919185a98bbc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:06.361819 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-82c09139-0c06-4103-b7ea-919185a98bbc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:06.363826 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-82c09139-0c06-4103-b7ea-919185a98bbc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.212142 May 12 14:32:06.364410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 55/122] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:06 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:07.101764 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7e28397c-1e88-4cb5-b8f6-dfff85519632 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:07.102534 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7e28397c-1e88-4cb5-b8f6-dfff85519632 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:07.108446 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7e28397c-1e88-4cb5-b8f6-dfff85519632 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:07.109023 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7e28397c-1e88-4cb5-b8f6-dfff85519632 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:07.109864 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7e28397c-1e88-4cb5-b8f6-dfff85519632 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:07.110389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7e28397c-1e88-4cb5-b8f6-dfff85519632 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:07.148935 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e4b22d83-76ad-4fea-a767-7c0beba3a2b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:07.149690 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e4b22d83-76ad-4fea-a767-7c0beba3a2b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:07.155908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e4b22d83-76ad-4fea-a767-7c0beba3a2b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:07.156561 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e4b22d83-76ad-4fea-a767-7c0beba3a2b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:07.157492 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e4b22d83-76ad-4fea-a767-7c0beba3a2b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:07.158113 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e4b22d83-76ad-4fea-a767-7c0beba3a2b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:07.299054 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7e28397c-1e88-4cb5-b8f6-dfff85519632 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:07.308904 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7e28397c-1e88-4cb5-b8f6-dfff85519632 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.211027 May 12 14:32:07.313603 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 68/123] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:07 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:07.329905 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e4b22d83-76ad-4fea-a767-7c0beba3a2b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:07.341614 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e4b22d83-76ad-4fea-a767-7c0beba3a2b3 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.196443 May 12 14:32:07.342269 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 56/124] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:07 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:32:07.388212 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b0d1cc2d-c0ce-49e7-866c-b5fc93905332 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:07.389193 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b0d1cc2d-c0ce-49e7-866c-b5fc93905332 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:07.396378 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b0d1cc2d-c0ce-49e7-866c-b5fc93905332 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:07.396842 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b0d1cc2d-c0ce-49e7-866c-b5fc93905332 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:07.397639 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b0d1cc2d-c0ce-49e7-866c-b5fc93905332 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:07.398081 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b0d1cc2d-c0ce-49e7-866c-b5fc93905332 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:07.537646 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-cb481e62-6ffd-4f0b-915b-9d24bf5d7d6b req-c6b74db1-d4c7-4b4c-b80f-ec5e71cfe401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e2a4c2-6255-4074-9a3c-e5159c3f7b87", "tag": "7fccb52d-a09a-4e64-adbe-8b42348d39c5"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:32:07.538723 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b0d1cc2d-c0ce-49e7-866c-b5fc93905332 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:07.546985 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b0d1cc2d-c0ce-49e7-866c-b5fc93905332 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:07.548637 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b0d1cc2d-c0ce-49e7-866c-b5fc93905332 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:07.549492 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-cb481e62-6ffd-4f0b-915b-9d24bf5d7d6b req-c6b74db1-d4c7-4b4c-b80f-ec5e71cfe401 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:07.549989 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b0d1cc2d-c0ce-49e7-866c-b5fc93905332 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.171546 May 12 14:32:07.550182 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-cb481e62-6ffd-4f0b-915b-9d24bf5d7d6b req-c6b74db1-d4c7-4b4c-b80f-ec5e71cfe401 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:07.550576 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 69/125] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:07 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:07.569913 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-cb481e62-6ffd-4f0b-915b-9d24bf5d7d6b req-c6b74db1-d4c7-4b4c-b80f-ec5e71cfe401 service nova] Creating event network-changed:7fccb52d-a09a-4e64-adbe-8b42348d39c5 for instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 on hv-cinder-77703 May 12 14:32:07.570692 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-cb481e62-6ffd-4f0b-915b-9d24bf5d7d6b req-c6b74db1-d4c7-4b4c-b80f-ec5e71cfe401 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118217) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 14:32:07.571925 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-163b3d5e-6afa-4b71-9a05-5d098433c972 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:07.572436 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-163b3d5e-6afa-4b71-9a05-5d098433c972 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:07.573239 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-163b3d5e-6afa-4b71-9a05-5d098433c972 None None] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:07.573677 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-163b3d5e-6afa-4b71-9a05-5d098433c972 None None] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:07.583452 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.compute.rpcapi [None req-163b3d5e-6afa-4b71-9a05-5d098433c972 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 14:32:07.584340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-163b3d5e-6afa-4b71-9a05-5d098433c972 None None] Releasing lock "compute-rpcapi-router" {{(pid=118217) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 14:32:07.601338 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-163b3d5e-6afa-4b71-9a05-5d098433c972 None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068309 May 12 14:32:07.601947 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 57/126] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:32:08.326171 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e4a9513a-5f91-4ca4-b7ee-26b70c1b9aa8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:08.326873 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e4a9513a-5f91-4ca4-b7ee-26b70c1b9aa8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:08.333408 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e4a9513a-5f91-4ca4-b7ee-26b70c1b9aa8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:08.333866 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e4a9513a-5f91-4ca4-b7ee-26b70c1b9aa8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:08.334673 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e4a9513a-5f91-4ca4-b7ee-26b70c1b9aa8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:08.335101 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e4a9513a-5f91-4ca4-b7ee-26b70c1b9aa8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:08.360705 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-82a001fc-3a7d-41fc-bca5-aa6826a0812b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:08.361433 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-82a001fc-3a7d-41fc-bca5-aa6826a0812b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:08.367886 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-82a001fc-3a7d-41fc-bca5-aa6826a0812b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:08.368338 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-82a001fc-3a7d-41fc-bca5-aa6826a0812b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:08.369120 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-82a001fc-3a7d-41fc-bca5-aa6826a0812b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:08.369560 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-82a001fc-3a7d-41fc-bca5-aa6826a0812b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:08.521938 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e4a9513a-5f91-4ca4-b7ee-26b70c1b9aa8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:08.529830 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e4a9513a-5f91-4ca4-b7ee-26b70c1b9aa8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.207301 May 12 14:32:08.530664 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 70/127] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:08 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:08.546796 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-82a001fc-3a7d-41fc-bca5-aa6826a0812b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:08.554499 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-82a001fc-3a7d-41fc-bca5-aa6826a0812b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.197895 May 12 14:32:08.555092 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 58/128] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:08 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:32:08.569045 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-93eb7a68-e990-40bd-a39f-76b59d0ea496 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:08.569656 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-93eb7a68-e990-40bd-a39f-76b59d0ea496 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:08.575709 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93eb7a68-e990-40bd-a39f-76b59d0ea496 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:08.576202 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93eb7a68-e990-40bd-a39f-76b59d0ea496 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:08.576965 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93eb7a68-e990-40bd-a39f-76b59d0ea496 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:08.578165 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93eb7a68-e990-40bd-a39f-76b59d0ea496 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:08.725375 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-93eb7a68-e990-40bd-a39f-76b59d0ea496 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:08.740642 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-93eb7a68-e990-40bd-a39f-76b59d0ea496 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:08.742252 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-93eb7a68-e990-40bd-a39f-76b59d0ea496 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:08.743416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-93eb7a68-e990-40bd-a39f-76b59d0ea496 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.178694 May 12 14:32:08.743985 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 71/129] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:08 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:09.554014 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2a35765f-14e1-45ce-a0df-8b035febc3f1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:09.554579 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2a35765f-14e1-45ce-a0df-8b035febc3f1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:09.561088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2a35765f-14e1-45ce-a0df-8b035febc3f1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:09.561905 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2a35765f-14e1-45ce-a0df-8b035febc3f1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:09.563003 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2a35765f-14e1-45ce-a0df-8b035febc3f1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:09.575631 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2a35765f-14e1-45ce-a0df-8b035febc3f1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:09.579246 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-54a8c49e-69d3-4d95-b8df-68f22998f22d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:09.580616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-54a8c49e-69d3-4d95-b8df-68f22998f22d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:09.589044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-54a8c49e-69d3-4d95-b8df-68f22998f22d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:09.589799 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-54a8c49e-69d3-4d95-b8df-68f22998f22d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:09.590867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-54a8c49e-69d3-4d95-b8df-68f22998f22d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:09.591929 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-54a8c49e-69d3-4d95-b8df-68f22998f22d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:10.020945 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2a35765f-14e1-45ce-a0df-8b035febc3f1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:10.028935 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2a35765f-14e1-45ce-a0df-8b035febc3f1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.480178 May 12 14:32:10.029600 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 59/130] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:09 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:10.043684 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-36927ed6-2a50-41f2-b705-ab0f9869c33c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:10.044297 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-36927ed6-2a50-41f2-b705-ab0f9869c33c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:10.050682 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-36927ed6-2a50-41f2-b705-ab0f9869c33c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:10.051198 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-36927ed6-2a50-41f2-b705-ab0f9869c33c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:10.052007 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-36927ed6-2a50-41f2-b705-ab0f9869c33c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:10.052434 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-36927ed6-2a50-41f2-b705-ab0f9869c33c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:10.060171 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-54a8c49e-69d3-4d95-b8df-68f22998f22d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:10.071442 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-54a8c49e-69d3-4d95-b8df-68f22998f22d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.502209 May 12 14:32:10.073258 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 72/131] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:09 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:10.348753 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-36927ed6-2a50-41f2-b705-ab0f9869c33c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:10.356804 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-36927ed6-2a50-41f2-b705-ab0f9869c33c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:10.358382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-36927ed6-2a50-41f2-b705-ab0f9869c33c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:10.359546 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-36927ed6-2a50-41f2-b705-ab0f9869c33c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.319734 May 12 14:32:10.360112 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 60/132] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:10 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:11.046633 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3668d461-e8c8-4d05-a4f0-5da276dd5644 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:11.047587 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3668d461-e8c8-4d05-a4f0-5da276dd5644 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:11.060268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3668d461-e8c8-4d05-a4f0-5da276dd5644 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:11.060724 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3668d461-e8c8-4d05-a4f0-5da276dd5644 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:11.061516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3668d461-e8c8-4d05-a4f0-5da276dd5644 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:11.061961 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3668d461-e8c8-4d05-a4f0-5da276dd5644 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:11.091099 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ec628279-c5d0-4d2e-83ba-99a8068852ab tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:11.092499 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ec628279-c5d0-4d2e-83ba-99a8068852ab tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:11.100626 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ec628279-c5d0-4d2e-83ba-99a8068852ab tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:11.101867 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ec628279-c5d0-4d2e-83ba-99a8068852ab tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:11.104892 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ec628279-c5d0-4d2e-83ba-99a8068852ab tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:11.105517 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ec628279-c5d0-4d2e-83ba-99a8068852ab tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:11.321182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3668d461-e8c8-4d05-a4f0-5da276dd5644 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:11.330278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3668d461-e8c8-4d05-a4f0-5da276dd5644 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.287758 May 12 14:32:11.332128 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 73/133] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:11 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:11.336157 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ec628279-c5d0-4d2e-83ba-99a8068852ab tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:11.345878 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ec628279-c5d0-4d2e-83ba-99a8068852ab tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.258868 May 12 14:32:11.348962 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 61/134] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:11 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:11.388174 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-57840882-76fc-4591-9df5-1c632a7352f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:11.389459 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-57840882-76fc-4591-9df5-1c632a7352f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:11.396151 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57840882-76fc-4591-9df5-1c632a7352f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:11.396696 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57840882-76fc-4591-9df5-1c632a7352f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:11.397554 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57840882-76fc-4591-9df5-1c632a7352f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:11.397998 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57840882-76fc-4591-9df5-1c632a7352f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:11.766702 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-57840882-76fc-4591-9df5-1c632a7352f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:11.776647 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-57840882-76fc-4591-9df5-1c632a7352f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:11.778179 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-57840882-76fc-4591-9df5-1c632a7352f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:11.779334 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-57840882-76fc-4591-9df5-1c632a7352f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.395028 May 12 14:32:11.780088 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 74/135] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:11 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:11.907591 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-038bff34-ab8a-4f2b-a088-8a1174f47041 req-d181d184-7906-43af-9aca-1beac35fd5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b422890a-65ed-4ca3-b19c-ec9fbba5e813", "name": "network-vif-plugged", "status": "completed", "tag": "5c15b5e9-eb16-450c-b4f2-aaddb6302fe6"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:32:11.918385 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-038bff34-ab8a-4f2b-a088-8a1174f47041 req-d181d184-7906-43af-9aca-1beac35fd5cf service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:11.918833 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-038bff34-ab8a-4f2b-a088-8a1174f47041 req-d181d184-7906-43af-9aca-1beac35fd5cf service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:11.934354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-038bff34-ab8a-4f2b-a088-8a1174f47041 req-d181d184-7906-43af-9aca-1beac35fd5cf service nova] Creating event network-vif-plugged:5c15b5e9-eb16-450c-b4f2-aaddb6302fe6 for instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 on hv-cinder-77703 May 12 14:32:11.940800 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-038bff34-ab8a-4f2b-a088-8a1174f47041 req-d181d184-7906-43af-9aca-1beac35fd5cf service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107789 May 12 14:32:11.941902 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 62/136] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:32:12.348722 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-95ed40da-04c7-4fac-858f-8f54d733bc43 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:12.349380 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-95ed40da-04c7-4fac-858f-8f54d733bc43 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:12.356132 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-95ed40da-04c7-4fac-858f-8f54d733bc43 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:12.356660 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-95ed40da-04c7-4fac-858f-8f54d733bc43 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:12.357458 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-95ed40da-04c7-4fac-858f-8f54d733bc43 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:12.364129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-08637f9f-5d25-44c3-ba58-e617b58e5e62 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:12.365588 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-08637f9f-5d25-44c3-ba58-e617b58e5e62 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:12.368767 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-95ed40da-04c7-4fac-858f-8f54d733bc43 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:12.376243 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-08637f9f-5d25-44c3-ba58-e617b58e5e62 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:12.377063 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-08637f9f-5d25-44c3-ba58-e617b58e5e62 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:12.378863 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-08637f9f-5d25-44c3-ba58-e617b58e5e62 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:12.379373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-08637f9f-5d25-44c3-ba58-e617b58e5e62 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:12.589587 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-08637f9f-5d25-44c3-ba58-e617b58e5e62 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:12.598045 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-08637f9f-5d25-44c3-ba58-e617b58e5e62 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.238531 May 12 14:32:12.598636 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 63/137] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:12 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:12.606773 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-95ed40da-04c7-4fac-858f-8f54d733bc43 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:12.614839 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-95ed40da-04c7-4fac-858f-8f54d733bc43 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.270707 May 12 14:32:12.615461 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 75/138] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:12 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:12.802286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-6c3e7914-daeb-41a9-a593-46f6afc11b2c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:12.803118 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-6c3e7914-daeb-41a9-a593-46f6afc11b2c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:12.811166 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6c3e7914-daeb-41a9-a593-46f6afc11b2c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:12.812064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6c3e7914-daeb-41a9-a593-46f6afc11b2c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:12.814606 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6c3e7914-daeb-41a9-a593-46f6afc11b2c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:12.815361 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6c3e7914-daeb-41a9-a593-46f6afc11b2c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:12.995209 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-6c3e7914-daeb-41a9-a593-46f6afc11b2c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:13.011942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-6c3e7914-daeb-41a9-a593-46f6afc11b2c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:13.013470 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-6c3e7914-daeb-41a9-a593-46f6afc11b2c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:13.014611 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-6c3e7914-daeb-41a9-a593-46f6afc11b2c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.220348 May 12 14:32:13.015208 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 64/139] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:12 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:32:13.622108 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7ada19ef-b53e-45fd-930f-c83c270dcedb tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:13.622757 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7ada19ef-b53e-45fd-930f-c83c270dcedb tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:13.632931 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8e55df7e-06bf-4973-9d15-e6ba8a3e16bf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:13.634616 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8e55df7e-06bf-4973-9d15-e6ba8a3e16bf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:13.640864 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ada19ef-b53e-45fd-930f-c83c270dcedb tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:13.641360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ada19ef-b53e-45fd-930f-c83c270dcedb tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:13.642186 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ada19ef-b53e-45fd-930f-c83c270dcedb tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:13.642625 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ada19ef-b53e-45fd-930f-c83c270dcedb tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:13.645406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8e55df7e-06bf-4973-9d15-e6ba8a3e16bf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:13.646400 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8e55df7e-06bf-4973-9d15-e6ba8a3e16bf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:13.647932 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8e55df7e-06bf-4973-9d15-e6ba8a3e16bf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:13.648662 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8e55df7e-06bf-4973-9d15-e6ba8a3e16bf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:13.945236 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8e55df7e-06bf-4973-9d15-e6ba8a3e16bf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:13.957785 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8e55df7e-06bf-4973-9d15-e6ba8a3e16bf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.329908 May 12 14:32:13.958647 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 65/140] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:13 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:13.980636 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7ada19ef-b53e-45fd-930f-c83c270dcedb tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:13.989988 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7ada19ef-b53e-45fd-930f-c83c270dcedb tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.377835 May 12 14:32:13.990942 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 76/141] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:13 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:14.033294 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7d388ad8-b1fa-4cfc-b89e-7256b04c0f99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:14.034444 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7d388ad8-b1fa-4cfc-b89e-7256b04c0f99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:14.040781 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7d388ad8-b1fa-4cfc-b89e-7256b04c0f99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:14.041253 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7d388ad8-b1fa-4cfc-b89e-7256b04c0f99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:14.042054 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7d388ad8-b1fa-4cfc-b89e-7256b04c0f99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:14.042825 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7d388ad8-b1fa-4cfc-b89e-7256b04c0f99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:14.213512 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7d388ad8-b1fa-4cfc-b89e-7256b04c0f99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:14.225289 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7d388ad8-b1fa-4cfc-b89e-7256b04c0f99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:14.228107 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7d388ad8-b1fa-4cfc-b89e-7256b04c0f99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:14.229831 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7d388ad8-b1fa-4cfc-b89e-7256b04c0f99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.200454 May 12 14:32:14.230494 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 66/142] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:14 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:14.980629 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-93a1c7a4-166f-4fc2-ae3f-1cc9c77558f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:14.982277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-93a1c7a4-166f-4fc2-ae3f-1cc9c77558f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:14.992078 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93a1c7a4-166f-4fc2-ae3f-1cc9c77558f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:14.992801 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93a1c7a4-166f-4fc2-ae3f-1cc9c77558f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:14.994053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93a1c7a4-166f-4fc2-ae3f-1cc9c77558f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:14.994789 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93a1c7a4-166f-4fc2-ae3f-1cc9c77558f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:15.010849 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e3f2c862-0f3a-444d-a604-f57ba9922196 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:15.011942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e3f2c862-0f3a-444d-a604-f57ba9922196 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:15.022051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e3f2c862-0f3a-444d-a604-f57ba9922196 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:15.022800 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e3f2c862-0f3a-444d-a604-f57ba9922196 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:15.024183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e3f2c862-0f3a-444d-a604-f57ba9922196 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:15.024912 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e3f2c862-0f3a-444d-a604-f57ba9922196 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:15.240644 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-93a1c7a4-166f-4fc2-ae3f-1cc9c77558f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:15.245159 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e3f2c862-0f3a-444d-a604-f57ba9922196 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:15.248656 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-93a1c7a4-166f-4fc2-ae3f-1cc9c77558f6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.273286 May 12 14:32:15.249248 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 77/143] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:14 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:15.253991 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-37765af8-a3da-4f52-9cc5-90404e426bba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:15.255018 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-37765af8-a3da-4f52-9cc5-90404e426bba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:15.256545 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e3f2c862-0f3a-444d-a604-f57ba9922196 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.252195 May 12 14:32:15.257340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 67/144] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:15 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:15.261696 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-37765af8-a3da-4f52-9cc5-90404e426bba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:15.262148 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-37765af8-a3da-4f52-9cc5-90404e426bba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:15.262929 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-37765af8-a3da-4f52-9cc5-90404e426bba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:15.263398 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-37765af8-a3da-4f52-9cc5-90404e426bba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:15.403758 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-37765af8-a3da-4f52-9cc5-90404e426bba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:15.411746 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-37765af8-a3da-4f52-9cc5-90404e426bba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:15.413248 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-37765af8-a3da-4f52-9cc5-90404e426bba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:15.414356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-37765af8-a3da-4f52-9cc5-90404e426bba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.164203 May 12 14:32:15.414935 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 78/145] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:15 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:16.266065 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0a212d61-5577-480a-97f8-04828b98cc4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:16.266697 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0a212d61-5577-480a-97f8-04828b98cc4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:16.273283 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0a212d61-5577-480a-97f8-04828b98cc4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:16.273468 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e009900d-6959-420a-a845-1b81b58496ed tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:16.274039 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e009900d-6959-420a-a845-1b81b58496ed tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:16.274655 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0a212d61-5577-480a-97f8-04828b98cc4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:16.275650 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0a212d61-5577-480a-97f8-04828b98cc4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:16.276276 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0a212d61-5577-480a-97f8-04828b98cc4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:16.280495 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e009900d-6959-420a-a845-1b81b58496ed tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:16.280993 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e009900d-6959-420a-a845-1b81b58496ed tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:16.281806 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e009900d-6959-420a-a845-1b81b58496ed tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:16.282406 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e009900d-6959-420a-a845-1b81b58496ed tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:16.494518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0a212d61-5577-480a-97f8-04828b98cc4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:16.502510 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0a212d61-5577-480a-97f8-04828b98cc4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.240644 May 12 14:32:16.503697 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 68/146] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:16 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:16.509147 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9ddfe055-f61c-4eac-85b8-6b59e4010aba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:16.509856 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9ddfe055-f61c-4eac-85b8-6b59e4010aba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:16.516890 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9ddfe055-f61c-4eac-85b8-6b59e4010aba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:16.517814 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9ddfe055-f61c-4eac-85b8-6b59e4010aba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:16.518968 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9ddfe055-f61c-4eac-85b8-6b59e4010aba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:16.519614 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9ddfe055-f61c-4eac-85b8-6b59e4010aba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:16.540539 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e009900d-6959-420a-a845-1b81b58496ed tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:16.550126 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e009900d-6959-420a-a845-1b81b58496ed tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.279182 May 12 14:32:16.550743 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 79/147] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:16 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:32:16.692870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9ddfe055-f61c-4eac-85b8-6b59e4010aba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:16.700820 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9ddfe055-f61c-4eac-85b8-6b59e4010aba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:16.702357 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9ddfe055-f61c-4eac-85b8-6b59e4010aba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:16.703530 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9ddfe055-f61c-4eac-85b8-6b59e4010aba tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.198633 May 12 14:32:16.704832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 69/148] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:16 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:17.521604 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-353e6c82-3563-496f-b548-b61971b09433 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:17.522249 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-353e6c82-3563-496f-b548-b61971b09433 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:17.528242 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-353e6c82-3563-496f-b548-b61971b09433 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:17.528693 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-353e6c82-3563-496f-b548-b61971b09433 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:17.529469 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-353e6c82-3563-496f-b548-b61971b09433 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:17.529907 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-353e6c82-3563-496f-b548-b61971b09433 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:17.569813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-177bb26a-dbda-42b3-a46b-9b56310be789 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:17.570631 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-177bb26a-dbda-42b3-a46b-9b56310be789 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:17.576839 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-177bb26a-dbda-42b3-a46b-9b56310be789 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:17.577373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-177bb26a-dbda-42b3-a46b-9b56310be789 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:17.578221 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-177bb26a-dbda-42b3-a46b-9b56310be789 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:17.578728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-177bb26a-dbda-42b3-a46b-9b56310be789 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:17.720835 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-353e6c82-3563-496f-b548-b61971b09433 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:17.731262 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-353e6c82-3563-496f-b548-b61971b09433 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.213875 May 12 14:32:17.731945 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 80/149] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:17 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:32:17.740680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d4cec672-a348-4623-bd0a-3f76b3dde0d2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:17.742002 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d4cec672-a348-4623-bd0a-3f76b3dde0d2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:17.748742 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d4cec672-a348-4623-bd0a-3f76b3dde0d2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:17.749191 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d4cec672-a348-4623-bd0a-3f76b3dde0d2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:17.749977 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d4cec672-a348-4623-bd0a-3f76b3dde0d2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:17.750412 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d4cec672-a348-4623-bd0a-3f76b3dde0d2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:17.762425 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-177bb26a-dbda-42b3-a46b-9b56310be789 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:17.775869 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-177bb26a-dbda-42b3-a46b-9b56310be789 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.210024 May 12 14:32:17.800411 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 70/150] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:17 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:32:17.920063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d4cec672-a348-4623-bd0a-3f76b3dde0d2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:17.933666 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d4cec672-a348-4623-bd0a-3f76b3dde0d2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:17.936411 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d4cec672-a348-4623-bd0a-3f76b3dde0d2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:17.938366 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d4cec672-a348-4623-bd0a-3f76b3dde0d2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.204826 May 12 14:32:17.939339 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 81/151] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:17 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:18.757054 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-480240e0-1b1b-456e-876f-7738bc478799 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:18.758213 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-480240e0-1b1b-456e-876f-7738bc478799 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:18.770399 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-480240e0-1b1b-456e-876f-7738bc478799 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:18.770399 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-480240e0-1b1b-456e-876f-7738bc478799 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:18.770399 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-480240e0-1b1b-456e-876f-7738bc478799 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:18.770399 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-480240e0-1b1b-456e-876f-7738bc478799 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:18.807330 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c7769252-7b7f-41b1-b70c-5e0f1b344658 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:18.808430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c7769252-7b7f-41b1-b70c-5e0f1b344658 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:18.817572 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c7769252-7b7f-41b1-b70c-5e0f1b344658 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:18.818494 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c7769252-7b7f-41b1-b70c-5e0f1b344658 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:18.820072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c7769252-7b7f-41b1-b70c-5e0f1b344658 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:18.820993 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c7769252-7b7f-41b1-b70c-5e0f1b344658 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:18.984950 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-480240e0-1b1b-456e-876f-7738bc478799 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:18.992788 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-480240e0-1b1b-456e-876f-7738bc478799 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.242880 May 12 14:32:18.993375 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 71/152] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:18 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:18.998379 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4fab4e93-60fa-45e5-9c62-05c55e5244ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:18.999217 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4fab4e93-60fa-45e5-9c62-05c55e5244ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:19.005493 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4fab4e93-60fa-45e5-9c62-05c55e5244ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:19.006217 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4fab4e93-60fa-45e5-9c62-05c55e5244ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:19.007002 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4fab4e93-60fa-45e5-9c62-05c55e5244ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:19.007748 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4fab4e93-60fa-45e5-9c62-05c55e5244ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:19.033145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c7769252-7b7f-41b1-b70c-5e0f1b344658 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:19.045828 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c7769252-7b7f-41b1-b70c-5e0f1b344658 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.242356 May 12 14:32:19.056587 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 82/153] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:18 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:19.153393 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4fab4e93-60fa-45e5-9c62-05c55e5244ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:19.161276 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4fab4e93-60fa-45e5-9c62-05c55e5244ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:19.162785 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4fab4e93-60fa-45e5-9c62-05c55e5244ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:19.164289 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4fab4e93-60fa-45e5-9c62-05c55e5244ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.169226 May 12 14:32:19.164808 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 72/154] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:18 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:20.009810 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-05b0ba6f-6558-47c2-9059-07a52b0c790a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:20.010414 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-05b0ba6f-6558-47c2-9059-07a52b0c790a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:20.016469 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-05b0ba6f-6558-47c2-9059-07a52b0c790a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:20.016926 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-05b0ba6f-6558-47c2-9059-07a52b0c790a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:20.017715 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-05b0ba6f-6558-47c2-9059-07a52b0c790a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:20.018155 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-05b0ba6f-6558-47c2-9059-07a52b0c790a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:20.063604 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7ba0aa4a-5548-400e-91e8-b60dca7fed30 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:20.064370 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7ba0aa4a-5548-400e-91e8-b60dca7fed30 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:20.070348 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7ba0aa4a-5548-400e-91e8-b60dca7fed30 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:20.071065 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7ba0aa4a-5548-400e-91e8-b60dca7fed30 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:20.072118 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7ba0aa4a-5548-400e-91e8-b60dca7fed30 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:20.072563 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7ba0aa4a-5548-400e-91e8-b60dca7fed30 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:20.225619 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-05b0ba6f-6558-47c2-9059-07a52b0c790a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:20.240273 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-05b0ba6f-6558-47c2-9059-07a52b0c790a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.234506 May 12 14:32:20.246125 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 83/155] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:20 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:20.250485 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7ba0aa4a-5548-400e-91e8-b60dca7fed30 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:20.254726 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d2a01c61-e3a3-4b31-b199-a6b71a5bbb39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:20.255358 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d2a01c61-e3a3-4b31-b199-a6b71a5bbb39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:20.258395 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7ba0aa4a-5548-400e-91e8-b60dca7fed30 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.198530 May 12 14:32:20.259107 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 73/156] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:20 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:32:20.262133 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d2a01c61-e3a3-4b31-b199-a6b71a5bbb39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:20.262587 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d2a01c61-e3a3-4b31-b199-a6b71a5bbb39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:20.263387 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d2a01c61-e3a3-4b31-b199-a6b71a5bbb39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:20.263828 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d2a01c61-e3a3-4b31-b199-a6b71a5bbb39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:20.410862 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d2a01c61-e3a3-4b31-b199-a6b71a5bbb39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:20.418927 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d2a01c61-e3a3-4b31-b199-a6b71a5bbb39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:20.420466 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d2a01c61-e3a3-4b31-b199-a6b71a5bbb39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:20.421587 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d2a01c61-e3a3-4b31-b199-a6b71a5bbb39 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.171199 May 12 14:32:20.422130 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 84/157] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:20 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:21.264795 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-50dda201-bb21-43be-97fc-3314711e073c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:21.265335 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-50dda201-bb21-43be-97fc-3314711e073c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:21.271787 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-50dda201-bb21-43be-97fc-3314711e073c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:21.272252 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-50dda201-bb21-43be-97fc-3314711e073c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:21.273168 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-50dda201-bb21-43be-97fc-3314711e073c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:21.273603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-50dda201-bb21-43be-97fc-3314711e073c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:21.278838 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1fb14051-09ef-4e9b-9b23-6c9448c38109 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:21.280092 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1fb14051-09ef-4e9b-9b23-6c9448c38109 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:21.287431 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1fb14051-09ef-4e9b-9b23-6c9448c38109 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:21.288294 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1fb14051-09ef-4e9b-9b23-6c9448c38109 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:21.289093 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1fb14051-09ef-4e9b-9b23-6c9448c38109 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:21.289536 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1fb14051-09ef-4e9b-9b23-6c9448c38109 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:21.492276 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-50dda201-bb21-43be-97fc-3314711e073c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:21.498068 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1fb14051-09ef-4e9b-9b23-6c9448c38109 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:21.507703 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-50dda201-bb21-43be-97fc-3314711e073c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.246857 May 12 14:32:21.508304 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 74/158] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:21 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:21.514601 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0ea4f5f0-e5d6-4d2b-ae86-22bf01782b28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:21.515544 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0ea4f5f0-e5d6-4d2b-ae86-22bf01782b28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:21.519923 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1fb14051-09ef-4e9b-9b23-6c9448c38109 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.245396 May 12 14:32:21.520518 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 85/159] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:21 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:21.525045 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0ea4f5f0-e5d6-4d2b-ae86-22bf01782b28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:21.525510 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0ea4f5f0-e5d6-4d2b-ae86-22bf01782b28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:21.526296 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0ea4f5f0-e5d6-4d2b-ae86-22bf01782b28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:21.526742 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0ea4f5f0-e5d6-4d2b-ae86-22bf01782b28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:21.686877 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0ea4f5f0-e5d6-4d2b-ae86-22bf01782b28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:21.694999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0ea4f5f0-e5d6-4d2b-ae86-22bf01782b28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:21.696583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0ea4f5f0-e5d6-4d2b-ae86-22bf01782b28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:21.697716 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0ea4f5f0-e5d6-4d2b-ae86-22bf01782b28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.187076 May 12 14:32:21.698289 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 75/160] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:21 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:22.525870 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-63d8a05d-3cf0-41df-a559-275cfe4ce411 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:22.527222 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-63d8a05d-3cf0-41df-a559-275cfe4ce411 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:22.534355 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-63d8a05d-3cf0-41df-a559-275cfe4ce411 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:22.534809 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-63d8a05d-3cf0-41df-a559-275cfe4ce411 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:22.535637 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-63d8a05d-3cf0-41df-a559-275cfe4ce411 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:22.536081 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-63d8a05d-3cf0-41df-a559-275cfe4ce411 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:22.546286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f67b207a-cef0-4dd9-9e6e-aa8c48945e0b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:22.548980 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f67b207a-cef0-4dd9-9e6e-aa8c48945e0b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:22.561895 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f67b207a-cef0-4dd9-9e6e-aa8c48945e0b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:22.562390 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f67b207a-cef0-4dd9-9e6e-aa8c48945e0b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:22.563199 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f67b207a-cef0-4dd9-9e6e-aa8c48945e0b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:22.563849 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f67b207a-cef0-4dd9-9e6e-aa8c48945e0b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:22.805597 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f67b207a-cef0-4dd9-9e6e-aa8c48945e0b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:22.810422 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-63d8a05d-3cf0-41df-a559-275cfe4ce411 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:22.822086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-63d8a05d-3cf0-41df-a559-275cfe4ce411 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.299859 May 12 14:32:22.822086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 86/161] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:22 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:22.825277 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f67b207a-cef0-4dd9-9e6e-aa8c48945e0b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.292160 May 12 14:32:22.825946 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 76/162] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:22 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:22.840196 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c53c874d-5356-429d-bc84-b28caebefbf5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:22.840848 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c53c874d-5356-429d-bc84-b28caebefbf5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:22.848459 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c53c874d-5356-429d-bc84-b28caebefbf5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:22.848832 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c53c874d-5356-429d-bc84-b28caebefbf5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:22.849840 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c53c874d-5356-429d-bc84-b28caebefbf5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:22.850509 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c53c874d-5356-429d-bc84-b28caebefbf5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:23.049035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c53c874d-5356-429d-bc84-b28caebefbf5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:23.059344 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c53c874d-5356-429d-bc84-b28caebefbf5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:23.061303 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c53c874d-5356-429d-bc84-b28caebefbf5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:23.063526 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c53c874d-5356-429d-bc84-b28caebefbf5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.240987 May 12 14:32:23.065023 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 87/163] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:22 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:23.838460 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d12d440c-35ea-44c3-979e-c3150bd43f10 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:23.839313 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d12d440c-35ea-44c3-979e-c3150bd43f10 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:23.843329 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-39d28b4d-d6f7-4a6b-847e-1b044496d58f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:23.843951 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-39d28b4d-d6f7-4a6b-847e-1b044496d58f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:23.845852 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d12d440c-35ea-44c3-979e-c3150bd43f10 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:23.846317 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d12d440c-35ea-44c3-979e-c3150bd43f10 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:23.847233 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d12d440c-35ea-44c3-979e-c3150bd43f10 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:23.847726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d12d440c-35ea-44c3-979e-c3150bd43f10 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:23.850165 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-39d28b4d-d6f7-4a6b-847e-1b044496d58f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:23.850615 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-39d28b4d-d6f7-4a6b-847e-1b044496d58f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:23.851456 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-39d28b4d-d6f7-4a6b-847e-1b044496d58f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:23.851893 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-39d28b4d-d6f7-4a6b-847e-1b044496d58f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:24.059312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-39d28b4d-d6f7-4a6b-847e-1b044496d58f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:24.061382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d12d440c-35ea-44c3-979e-c3150bd43f10 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:24.068325 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-39d28b4d-d6f7-4a6b-847e-1b044496d58f tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.228681 May 12 14:32:24.069354 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 88/164] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:23 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:32:24.070130 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d12d440c-35ea-44c3-979e-c3150bd43f10 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.236035 May 12 14:32:24.070708 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 77/165] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:23 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:24.083616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-84e00b0a-8534-49d3-87d1-4fb23aad42ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:24.084321 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-84e00b0a-8534-49d3-87d1-4fb23aad42ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:24.090559 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84e00b0a-8534-49d3-87d1-4fb23aad42ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:24.091015 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84e00b0a-8534-49d3-87d1-4fb23aad42ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:24.091821 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84e00b0a-8534-49d3-87d1-4fb23aad42ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:24.092268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84e00b0a-8534-49d3-87d1-4fb23aad42ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:24.247649 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-84e00b0a-8534-49d3-87d1-4fb23aad42ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:24.257985 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-84e00b0a-8534-49d3-87d1-4fb23aad42ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:24.259560 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-84e00b0a-8534-49d3-87d1-4fb23aad42ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:24.260697 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-84e00b0a-8534-49d3-87d1-4fb23aad42ae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.181729 May 12 14:32:24.261276 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 89/166] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:24 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:25.007791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-240c542a-78e0-465d-a86a-12c3f6d8fd06 req-362eccfa-7a82-418f-ae2f-e025a0c52f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fab0a31-9c59-40c0-8350-788bf0458078", "name": "network-vif-plugged", "status": "completed", "tag": "c3aac594-e895-4346-8c61-7bc47bc88813"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:32:25.020773 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-240c542a-78e0-465d-a86a-12c3f6d8fd06 req-362eccfa-7a82-418f-ae2f-e025a0c52f17 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:25.021280 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-240c542a-78e0-465d-a86a-12c3f6d8fd06 req-362eccfa-7a82-418f-ae2f-e025a0c52f17 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:25.038586 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-240c542a-78e0-465d-a86a-12c3f6d8fd06 req-362eccfa-7a82-418f-ae2f-e025a0c52f17 service nova] Creating event network-vif-plugged:c3aac594-e895-4346-8c61-7bc47bc88813 for instance 1fab0a31-9c59-40c0-8350-788bf0458078 on hv-cinder-77703 May 12 14:32:25.046292 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-240c542a-78e0-465d-a86a-12c3f6d8fd06 req-362eccfa-7a82-418f-ae2f-e025a0c52f17 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043011 May 12 14:32:25.047271 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 78/167] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:32:25.086021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-68e9837f-0367-4de1-9a7a-12e42cca8369 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:25.087408 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-68e9837f-0367-4de1-9a7a-12e42cca8369 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:25.089376 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-221c71aa-46b6-4bc8-a140-9f9329ee319a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:25.090096 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-221c71aa-46b6-4bc8-a140-9f9329ee319a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:25.094919 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-68e9837f-0367-4de1-9a7a-12e42cca8369 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:25.095732 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-68e9837f-0367-4de1-9a7a-12e42cca8369 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:25.097587 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-68e9837f-0367-4de1-9a7a-12e42cca8369 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:25.098442 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-68e9837f-0367-4de1-9a7a-12e42cca8369 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:25.102890 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-221c71aa-46b6-4bc8-a140-9f9329ee319a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:25.103427 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-221c71aa-46b6-4bc8-a140-9f9329ee319a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:25.104163 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-221c71aa-46b6-4bc8-a140-9f9329ee319a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:25.104612 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-221c71aa-46b6-4bc8-a140-9f9329ee319a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:25.315666 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-68e9837f-0367-4de1-9a7a-12e42cca8369 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:25.323294 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-68e9837f-0367-4de1-9a7a-12e42cca8369 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.242528 May 12 14:32:25.323871 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 90/168] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:25 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:25.338302 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6897a0ba-e81a-4589-8ae7-2d6459288f59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:25.339175 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6897a0ba-e81a-4589-8ae7-2d6459288f59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:25.347803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-221c71aa-46b6-4bc8-a140-9f9329ee319a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:25.356015 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-221c71aa-46b6-4bc8-a140-9f9329ee319a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.271610 May 12 14:32:25.356703 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 79/169] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:25 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:32:25.359386 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6897a0ba-e81a-4589-8ae7-2d6459288f59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:25.359818 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6897a0ba-e81a-4589-8ae7-2d6459288f59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:25.360789 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6897a0ba-e81a-4589-8ae7-2d6459288f59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:25.361377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6897a0ba-e81a-4589-8ae7-2d6459288f59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:25.537831 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6897a0ba-e81a-4589-8ae7-2d6459288f59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:25.546317 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6897a0ba-e81a-4589-8ae7-2d6459288f59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:25.547928 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6897a0ba-e81a-4589-8ae7-2d6459288f59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:25.549053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6897a0ba-e81a-4589-8ae7-2d6459288f59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.214607 May 12 14:32:25.559061 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 91/170] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:25 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:26.344283 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-03a206ce-0be1-43b1-9499-110fcfef6e72 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:26.345490 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-03a206ce-0be1-43b1-9499-110fcfef6e72 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:26.358219 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-03a206ce-0be1-43b1-9499-110fcfef6e72 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:26.359075 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-03a206ce-0be1-43b1-9499-110fcfef6e72 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:26.360394 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-03a206ce-0be1-43b1-9499-110fcfef6e72 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:26.361029 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-03a206ce-0be1-43b1-9499-110fcfef6e72 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:26.378058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0286c01e-ebaf-4a40-9dbf-f7860727ef50 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:26.379442 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0286c01e-ebaf-4a40-9dbf-f7860727ef50 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:26.389717 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0286c01e-ebaf-4a40-9dbf-f7860727ef50 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:26.393077 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0286c01e-ebaf-4a40-9dbf-f7860727ef50 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:26.394086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0286c01e-ebaf-4a40-9dbf-f7860727ef50 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:26.394612 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0286c01e-ebaf-4a40-9dbf-f7860727ef50 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:26.664333 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-03a206ce-0be1-43b1-9499-110fcfef6e72 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:26.668183 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0286c01e-ebaf-4a40-9dbf-f7860727ef50 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:26.673062 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-03a206ce-0be1-43b1-9499-110fcfef6e72 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.333688 May 12 14:32:26.673741 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 80/171] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:26 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:26.677405 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0286c01e-ebaf-4a40-9dbf-f7860727ef50 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.303695 May 12 14:32:26.678149 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 92/172] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:26 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:26.690308 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b7b316e3-0ce3-4868-996d-5c3c401b65d9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:26.691611 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b7b316e3-0ce3-4868-996d-5c3c401b65d9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:26.698461 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b7b316e3-0ce3-4868-996d-5c3c401b65d9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:26.698845 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b7b316e3-0ce3-4868-996d-5c3c401b65d9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:26.699685 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b7b316e3-0ce3-4868-996d-5c3c401b65d9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:26.703081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b7b316e3-0ce3-4868-996d-5c3c401b65d9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:26.913376 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b7b316e3-0ce3-4868-996d-5c3c401b65d9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:26.924161 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b7b316e3-0ce3-4868-996d-5c3c401b65d9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:26.926940 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b7b316e3-0ce3-4868-996d-5c3c401b65d9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:26.929225 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b7b316e3-0ce3-4868-996d-5c3c401b65d9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.244393 May 12 14:32:26.930543 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 81/173] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:26 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:27.699203 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c87414bd-96f1-4f5d-85c5-d42c0045db16 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:27.701168 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-986d8dd4-a6b3-4e1c-aa92-69ac8ce7feba tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:27.702351 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-986d8dd4-a6b3-4e1c-aa92-69ac8ce7feba tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:27.703554 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c87414bd-96f1-4f5d-85c5-d42c0045db16 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:27.727745 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c87414bd-96f1-4f5d-85c5-d42c0045db16 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:27.728827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-986d8dd4-a6b3-4e1c-aa92-69ac8ce7feba tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:27.729184 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-986d8dd4-a6b3-4e1c-aa92-69ac8ce7feba tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:27.729987 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-986d8dd4-a6b3-4e1c-aa92-69ac8ce7feba tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:27.730429 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-986d8dd4-a6b3-4e1c-aa92-69ac8ce7feba tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:27.735075 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c87414bd-96f1-4f5d-85c5-d42c0045db16 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:27.740075 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c87414bd-96f1-4f5d-85c5-d42c0045db16 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:27.740870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c87414bd-96f1-4f5d-85c5-d42c0045db16 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:28.081884 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c87414bd-96f1-4f5d-85c5-d42c0045db16 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:28.094980 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c87414bd-96f1-4f5d-85c5-d42c0045db16 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.402614 May 12 14:32:28.095756 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 82/174] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:27 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:28.108155 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0854c25b-77bf-4752-9ec8-644d2481c81c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:28.109542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0854c25b-77bf-4752-9ec8-644d2481c81c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:28.118471 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0854c25b-77bf-4752-9ec8-644d2481c81c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:28.118991 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0854c25b-77bf-4752-9ec8-644d2481c81c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:28.120201 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0854c25b-77bf-4752-9ec8-644d2481c81c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:28.120668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-986d8dd4-a6b3-4e1c-aa92-69ac8ce7feba tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:28.121108 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0854c25b-77bf-4752-9ec8-644d2481c81c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:28.130332 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-986d8dd4-a6b3-4e1c-aa92-69ac8ce7feba tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.438916 May 12 14:32:28.131921 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 93/175] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:27 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:28.296433 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0854c25b-77bf-4752-9ec8-644d2481c81c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:28.311253 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0854c25b-77bf-4752-9ec8-644d2481c81c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:28.313086 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0854c25b-77bf-4752-9ec8-644d2481c81c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:28.314367 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0854c25b-77bf-4752-9ec8-644d2481c81c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.216662 May 12 14:32:28.314987 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 83/176] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:28 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:29.117589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-552ac061-5079-4e3f-8c3b-862e57866a89 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:29.118252 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-552ac061-5079-4e3f-8c3b-862e57866a89 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:29.127950 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-552ac061-5079-4e3f-8c3b-862e57866a89 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:29.128403 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-552ac061-5079-4e3f-8c3b-862e57866a89 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:29.129352 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-552ac061-5079-4e3f-8c3b-862e57866a89 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:29.129791 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-552ac061-5079-4e3f-8c3b-862e57866a89 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:29.148722 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1aa05ba9-13fb-40c9-af66-fd0c7f2c96c8 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:29.149339 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1aa05ba9-13fb-40c9-af66-fd0c7f2c96c8 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:29.160829 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1aa05ba9-13fb-40c9-af66-fd0c7f2c96c8 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:29.161274 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1aa05ba9-13fb-40c9-af66-fd0c7f2c96c8 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:29.162067 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1aa05ba9-13fb-40c9-af66-fd0c7f2c96c8 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:29.162501 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1aa05ba9-13fb-40c9-af66-fd0c7f2c96c8 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:29.371821 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-552ac061-5079-4e3f-8c3b-862e57866a89 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:29.381168 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1aa05ba9-13fb-40c9-af66-fd0c7f2c96c8 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:29.381949 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-552ac061-5079-4e3f-8c3b-862e57866a89 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.272905 May 12 14:32:29.382533 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 94/177] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:29 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:29.387623 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c1d1ac5c-2505-4569-a85e-a4d13277d305 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:29.388515 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c1d1ac5c-2505-4569-a85e-a4d13277d305 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:29.398178 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1aa05ba9-13fb-40c9-af66-fd0c7f2c96c8 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.253389 May 12 14:32:29.398772 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 84/178] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:29 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:29.399475 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c1d1ac5c-2505-4569-a85e-a4d13277d305 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:29.400033 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c1d1ac5c-2505-4569-a85e-a4d13277d305 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:29.400901 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c1d1ac5c-2505-4569-a85e-a4d13277d305 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:29.401413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c1d1ac5c-2505-4569-a85e-a4d13277d305 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:29.580883 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c1d1ac5c-2505-4569-a85e-a4d13277d305 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:29.589462 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c1d1ac5c-2505-4569-a85e-a4d13277d305 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:29.591197 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c1d1ac5c-2505-4569-a85e-a4d13277d305 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:29.592599 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c1d1ac5c-2505-4569-a85e-a4d13277d305 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.208853 May 12 14:32:29.593381 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 95/179] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:29 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:30.401438 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-947764a2-5552-44f0-9447-735db349a637 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:30.402058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-947764a2-5552-44f0-9447-735db349a637 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:30.410333 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-947764a2-5552-44f0-9447-735db349a637 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:30.411329 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-947764a2-5552-44f0-9447-735db349a637 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:30.411715 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-947764a2-5552-44f0-9447-735db349a637 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:30.412161 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-947764a2-5552-44f0-9447-735db349a637 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:30.416870 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-616afca0-66b8-488b-b479-a0fab40a9a02 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:30.417646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-616afca0-66b8-488b-b479-a0fab40a9a02 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:30.430505 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-616afca0-66b8-488b-b479-a0fab40a9a02 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:30.431256 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-616afca0-66b8-488b-b479-a0fab40a9a02 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:30.432231 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-616afca0-66b8-488b-b479-a0fab40a9a02 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:30.433216 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-616afca0-66b8-488b-b479-a0fab40a9a02 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:30.789664 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-947764a2-5552-44f0-9447-735db349a637 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:30.797174 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-947764a2-5552-44f0-9447-735db349a637 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.400205 May 12 14:32:30.797997 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 85/180] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:30 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:30.802951 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-dd809633-4b6b-4044-8def-ea55a380af42 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:30.803598 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-dd809633-4b6b-4044-8def-ea55a380af42 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:30.809570 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dd809633-4b6b-4044-8def-ea55a380af42 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:30.810245 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dd809633-4b6b-4044-8def-ea55a380af42 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:30.811492 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dd809633-4b6b-4044-8def-ea55a380af42 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:30.812151 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dd809633-4b6b-4044-8def-ea55a380af42 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:30.837490 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-616afca0-66b8-488b-b479-a0fab40a9a02 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:30.847726 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-616afca0-66b8-488b-b479-a0fab40a9a02 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.434535 May 12 14:32:30.851416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 96/181] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:30 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:30.993645 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-dd809633-4b6b-4044-8def-ea55a380af42 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:31.002572 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-dd809633-4b6b-4044-8def-ea55a380af42 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:31.004316 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-dd809633-4b6b-4044-8def-ea55a380af42 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:31.006113 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-dd809633-4b6b-4044-8def-ea55a380af42 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.206513 May 12 14:32:31.006715 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 86/182] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:30 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:31.815591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ab9286c4-6387-4cd4-82bf-59909c9b432e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:31.816622 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ab9286c4-6387-4cd4-82bf-59909c9b432e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:31.827153 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ab9286c4-6387-4cd4-82bf-59909c9b432e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:31.827851 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ab9286c4-6387-4cd4-82bf-59909c9b432e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:31.834235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ab9286c4-6387-4cd4-82bf-59909c9b432e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:31.835048 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ab9286c4-6387-4cd4-82bf-59909c9b432e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:31.865256 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-241d1bdb-1376-499f-b46b-173d68193211 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:31.866008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-241d1bdb-1376-499f-b46b-173d68193211 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:31.872315 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-241d1bdb-1376-499f-b46b-173d68193211 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:31.875022 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-241d1bdb-1376-499f-b46b-173d68193211 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:31.882740 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-241d1bdb-1376-499f-b46b-173d68193211 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:31.883287 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-241d1bdb-1376-499f-b46b-173d68193211 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:32.107557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ab9286c4-6387-4cd4-82bf-59909c9b432e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:32.121574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ab9286c4-6387-4cd4-82bf-59909c9b432e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.310492 May 12 14:32:32.122148 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-241d1bdb-1376-499f-b46b-173d68193211 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:32.130117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-241d1bdb-1376-499f-b46b-173d68193211 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.269584 May 12 14:32:32.131228 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 87/183] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:31 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:32:32.131610 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 97/184] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:31 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:32:32.136151 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-87cedd07-d259-4a70-bcdc-279dd8320ff2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:32.136849 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-87cedd07-d259-4a70-bcdc-279dd8320ff2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:32.143406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-87cedd07-d259-4a70-bcdc-279dd8320ff2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:32.146710 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-87cedd07-d259-4a70-bcdc-279dd8320ff2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:32.147628 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-87cedd07-d259-4a70-bcdc-279dd8320ff2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:32.148087 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-87cedd07-d259-4a70-bcdc-279dd8320ff2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:32.311153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-87cedd07-d259-4a70-bcdc-279dd8320ff2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:32.320242 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-87cedd07-d259-4a70-bcdc-279dd8320ff2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:32.321759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-87cedd07-d259-4a70-bcdc-279dd8320ff2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:32.322883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-87cedd07-d259-4a70-bcdc-279dd8320ff2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.190417 May 12 14:32:32.323483 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 88/185] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:32 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:32.431100 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-708f838e-48c2-4250-bb64-7d46673fad10 req-f3c2577c-9cd0-45a1-9498-4fe1e904be81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e2a4c2-6255-4074-9a3c-e5159c3f7b87", "name": "network-vif-plugged", "status": "completed", "tag": "7fccb52d-a09a-4e64-adbe-8b42348d39c5"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:32:32.441511 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-708f838e-48c2-4250-bb64-7d46673fad10 req-f3c2577c-9cd0-45a1-9498-4fe1e904be81 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:32.441893 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-708f838e-48c2-4250-bb64-7d46673fad10 req-f3c2577c-9cd0-45a1-9498-4fe1e904be81 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:32.457547 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-708f838e-48c2-4250-bb64-7d46673fad10 req-f3c2577c-9cd0-45a1-9498-4fe1e904be81 service nova] Creating event network-vif-plugged:7fccb52d-a09a-4e64-adbe-8b42348d39c5 for instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 on hv-cinder-77703 May 12 14:32:32.464995 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-708f838e-48c2-4250-bb64-7d46673fad10 req-f3c2577c-9cd0-45a1-9498-4fe1e904be81 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037554 May 12 14:32:32.466165 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 98/186] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:32:33.141857 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-79206ec5-76c9-41e4-b261-ebdb5c9bffe1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:33.143010 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-79206ec5-76c9-41e4-b261-ebdb5c9bffe1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:33.151051 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d4d200a3-8457-4fe2-831f-98528f610111 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:33.153445 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d4d200a3-8457-4fe2-831f-98528f610111 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:33.153983 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-79206ec5-76c9-41e4-b261-ebdb5c9bffe1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:33.157492 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-79206ec5-76c9-41e4-b261-ebdb5c9bffe1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:33.161384 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-79206ec5-76c9-41e4-b261-ebdb5c9bffe1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:33.162361 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d4d200a3-8457-4fe2-831f-98528f610111 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:33.162487 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-79206ec5-76c9-41e4-b261-ebdb5c9bffe1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:33.163371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d4d200a3-8457-4fe2-831f-98528f610111 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:33.164849 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d4d200a3-8457-4fe2-831f-98528f610111 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:33.165784 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d4d200a3-8457-4fe2-831f-98528f610111 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:33.720875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d4d200a3-8457-4fe2-831f-98528f610111 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:33.722620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-79206ec5-76c9-41e4-b261-ebdb5c9bffe1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:33.732475 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-79206ec5-76c9-41e4-b261-ebdb5c9bffe1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1368 microversion: 2.1 time: 0.595452 May 12 14:32:33.734830 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d4d200a3-8457-4fe2-831f-98528f610111 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.590454 May 12 14:32:33.739755 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 89/187] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:33 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1368 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:33.746628 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 99/188] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:33 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:32:33.751708 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-718cf96c-be2c-4a04-bfe8-8db9deea3e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:33.752908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-718cf96c-be2c-4a04-bfe8-8db9deea3e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:33.764291 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-718cf96c-be2c-4a04-bfe8-8db9deea3e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:33.764971 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-718cf96c-be2c-4a04-bfe8-8db9deea3e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:33.766487 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-718cf96c-be2c-4a04-bfe8-8db9deea3e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:33.767169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-718cf96c-be2c-4a04-bfe8-8db9deea3e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:33.976096 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-718cf96c-be2c-4a04-bfe8-8db9deea3e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:33.996607 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-718cf96c-be2c-4a04-bfe8-8db9deea3e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:33.998615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-718cf96c-be2c-4a04-bfe8-8db9deea3e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:34.000001 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-718cf96c-be2c-4a04-bfe8-8db9deea3e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.257980 May 12 14:32:34.001507 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 90/189] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:33 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:34.754858 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-84b18e8a-c843-4b19-bbd4-f3d7107ee574 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:34.755823 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-84b18e8a-c843-4b19-bbd4-f3d7107ee574 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:34.758044 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-52071425-15b6-41c7-9c40-fb979fbe6ac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:34.759400 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-52071425-15b6-41c7-9c40-fb979fbe6ac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:34.766749 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-52071425-15b6-41c7-9c40-fb979fbe6ac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:34.768582 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-52071425-15b6-41c7-9c40-fb979fbe6ac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:34.769629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-52071425-15b6-41c7-9c40-fb979fbe6ac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:34.770401 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-52071425-15b6-41c7-9c40-fb979fbe6ac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:34.772342 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84b18e8a-c843-4b19-bbd4-f3d7107ee574 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:34.772814 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84b18e8a-c843-4b19-bbd4-f3d7107ee574 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:34.773628 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84b18e8a-c843-4b19-bbd4-f3d7107ee574 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:34.774657 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84b18e8a-c843-4b19-bbd4-f3d7107ee574 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:35.037932 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-84b18e8a-c843-4b19-bbd4-f3d7107ee574 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:35.047802 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-84b18e8a-c843-4b19-bbd4-f3d7107ee574 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1315 microversion: 2.1 time: 0.298509 May 12 14:32:35.057818 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 100/190] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:34 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:35.063124 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-375a5b47-a1fb-4028-8044-e477798f0dc0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:35.064093 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-375a5b47-a1fb-4028-8044-e477798f0dc0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:35.072617 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-375a5b47-a1fb-4028-8044-e477798f0dc0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:35.073335 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-375a5b47-a1fb-4028-8044-e477798f0dc0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:35.074264 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-375a5b47-a1fb-4028-8044-e477798f0dc0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:35.074832 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-375a5b47-a1fb-4028-8044-e477798f0dc0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:35.092337 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-52071425-15b6-41c7-9c40-fb979fbe6ac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:35.101672 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-52071425-15b6-41c7-9c40-fb979fbe6ac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1558 microversion: 2.1 time: 0.352228 May 12 14:32:35.103640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 91/191] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:34 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1558 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:35.124932 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8d899282-7e18-4787-a8ad-1ed13e058a77 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:35.125401 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8d899282-7e18-4787-a8ad-1ed13e058a77 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:35.147687 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d899282-7e18-4787-a8ad-1ed13e058a77 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:35.148319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d899282-7e18-4787-a8ad-1ed13e058a77 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:35.149437 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d899282-7e18-4787-a8ad-1ed13e058a77 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:35.150974 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d899282-7e18-4787-a8ad-1ed13e058a77 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:35.306402 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-375a5b47-a1fb-4028-8044-e477798f0dc0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:35.320093 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-375a5b47-a1fb-4028-8044-e477798f0dc0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:35.325041 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-375a5b47-a1fb-4028-8044-e477798f0dc0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:35.327468 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-375a5b47-a1fb-4028-8044-e477798f0dc0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.267890 May 12 14:32:35.328541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 101/192] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:35 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:35.396196 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8d899282-7e18-4787-a8ad-1ed13e058a77 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.279544 May 12 14:32:35.396795 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 92/193] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 12 14:32:35 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078/os-interface => generated 285 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:32:36.064336 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-83c53551-c4bf-4032-9101-86a432e7ef0d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:36.066001 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-83c53551-c4bf-4032-9101-86a432e7ef0d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:36.072494 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-83c53551-c4bf-4032-9101-86a432e7ef0d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:36.073262 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-83c53551-c4bf-4032-9101-86a432e7ef0d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:36.074404 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-83c53551-c4bf-4032-9101-86a432e7ef0d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:36.074906 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-83c53551-c4bf-4032-9101-86a432e7ef0d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:36.259116 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-83c53551-c4bf-4032-9101-86a432e7ef0d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:36.268853 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-83c53551-c4bf-4032-9101-86a432e7ef0d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1502 microversion: 2.1 time: 0.208348 May 12 14:32:36.286051 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 102/194] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:32:36 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:32:36.363907 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3408eeaa-1337-463a-af00-1d0a693d94df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:36.365876 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3408eeaa-1337-463a-af00-1d0a693d94df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:36.383640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3408eeaa-1337-463a-af00-1d0a693d94df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:36.384148 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3408eeaa-1337-463a-af00-1d0a693d94df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:36.386964 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3408eeaa-1337-463a-af00-1d0a693d94df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:36.387494 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3408eeaa-1337-463a-af00-1d0a693d94df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:36.633224 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3408eeaa-1337-463a-af00-1d0a693d94df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:36.647275 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3408eeaa-1337-463a-af00-1d0a693d94df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:36.648661 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3408eeaa-1337-463a-af00-1d0a693d94df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:36.655568 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3408eeaa-1337-463a-af00-1d0a693d94df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.308391 May 12 14:32:36.667629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 93/195] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:36 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:37.674449 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-dd24d5ab-a137-44da-b977-ea6e2872a492 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:37.675413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-dd24d5ab-a137-44da-b977-ea6e2872a492 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:37.685805 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dd24d5ab-a137-44da-b977-ea6e2872a492 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:37.686453 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dd24d5ab-a137-44da-b977-ea6e2872a492 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:37.692147 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dd24d5ab-a137-44da-b977-ea6e2872a492 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:37.692997 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dd24d5ab-a137-44da-b977-ea6e2872a492 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:37.921537 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-dd24d5ab-a137-44da-b977-ea6e2872a492 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:37.933729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-dd24d5ab-a137-44da-b977-ea6e2872a492 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:37.936930 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-dd24d5ab-a137-44da-b977-ea6e2872a492 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:37.939022 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-dd24d5ab-a137-44da-b977-ea6e2872a492 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.268996 May 12 14:32:37.950838 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 103/196] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:37 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:38.016626 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-0fab564f-dc54-4361-97df-011f3f43e0eb req-b1361280-483b-470c-b09c-90b16ec249ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fab0a31-9c59-40c0-8350-788bf0458078", "tag": "c3aac594-e895-4346-8c61-7bc47bc88813"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:32:38.031176 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-0fab564f-dc54-4361-97df-011f3f43e0eb req-b1361280-483b-470c-b09c-90b16ec249ef service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:38.035389 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-0fab564f-dc54-4361-97df-011f3f43e0eb req-b1361280-483b-470c-b09c-90b16ec249ef service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:38.048583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-0fab564f-dc54-4361-97df-011f3f43e0eb req-b1361280-483b-470c-b09c-90b16ec249ef service nova] Creating event network-changed:c3aac594-e895-4346-8c61-7bc47bc88813 for instance 1fab0a31-9c59-40c0-8350-788bf0458078 on hv-cinder-77703 May 12 14:32:38.058640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-0fab564f-dc54-4361-97df-011f3f43e0eb req-b1361280-483b-470c-b09c-90b16ec249ef service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263526 May 12 14:32:38.059360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 94/197] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:32:38.959566 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f8b34fdb-d42d-4ab2-ad9e-4ab66e603a10 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:38.961873 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f8b34fdb-d42d-4ab2-ad9e-4ab66e603a10 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:38.971927 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f8b34fdb-d42d-4ab2-ad9e-4ab66e603a10 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:38.972602 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f8b34fdb-d42d-4ab2-ad9e-4ab66e603a10 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:38.973543 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f8b34fdb-d42d-4ab2-ad9e-4ab66e603a10 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:38.974132 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f8b34fdb-d42d-4ab2-ad9e-4ab66e603a10 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:39.146912 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f8b34fdb-d42d-4ab2-ad9e-4ab66e603a10 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:39.158299 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f8b34fdb-d42d-4ab2-ad9e-4ab66e603a10 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:39.159705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f8b34fdb-d42d-4ab2-ad9e-4ab66e603a10 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:39.160877 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f8b34fdb-d42d-4ab2-ad9e-4ab66e603a10 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.206879 May 12 14:32:39.161439 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 104/198] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:38 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:40.178617 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f6fefd67-368e-480a-af01-9b848dd807df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:40.179339 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f6fefd67-368e-480a-af01-9b848dd807df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:40.185958 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f6fefd67-368e-480a-af01-9b848dd807df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:40.186537 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f6fefd67-368e-480a-af01-9b848dd807df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:40.187405 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f6fefd67-368e-480a-af01-9b848dd807df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:40.187839 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f6fefd67-368e-480a-af01-9b848dd807df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:40.333300 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f6fefd67-368e-480a-af01-9b848dd807df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:40.344185 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f6fefd67-368e-480a-af01-9b848dd807df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:40.346221 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f6fefd67-368e-480a-af01-9b848dd807df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:40.347445 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f6fefd67-368e-480a-af01-9b848dd807df tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.173156 May 12 14:32:40.348020 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 95/199] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:40 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:41.365635 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-47fe3484-daad-4dc7-a3b2-97918ae9a22a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:41.366395 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-47fe3484-daad-4dc7-a3b2-97918ae9a22a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:41.372437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-47fe3484-daad-4dc7-a3b2-97918ae9a22a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:41.372891 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-47fe3484-daad-4dc7-a3b2-97918ae9a22a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:41.373677 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-47fe3484-daad-4dc7-a3b2-97918ae9a22a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:41.374108 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-47fe3484-daad-4dc7-a3b2-97918ae9a22a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:41.507608 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-47fe3484-daad-4dc7-a3b2-97918ae9a22a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:41.516109 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-47fe3484-daad-4dc7-a3b2-97918ae9a22a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:41.518330 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-47fe3484-daad-4dc7-a3b2-97918ae9a22a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:41.520275 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-47fe3484-daad-4dc7-a3b2-97918ae9a22a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.157779 May 12 14:32:41.520275 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 105/200] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:41 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:42.537352 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f21688bb-e8e2-4149-a5b6-072693ea4e3e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:42.537961 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f21688bb-e8e2-4149-a5b6-072693ea4e3e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:42.544016 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f21688bb-e8e2-4149-a5b6-072693ea4e3e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:42.544472 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f21688bb-e8e2-4149-a5b6-072693ea4e3e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:42.545583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f21688bb-e8e2-4149-a5b6-072693ea4e3e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:42.546058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f21688bb-e8e2-4149-a5b6-072693ea4e3e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:42.677812 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f21688bb-e8e2-4149-a5b6-072693ea4e3e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:42.685606 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f21688bb-e8e2-4149-a5b6-072693ea4e3e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:42.687150 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f21688bb-e8e2-4149-a5b6-072693ea4e3e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:42.688258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f21688bb-e8e2-4149-a5b6-072693ea4e3e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.154855 May 12 14:32:42.688818 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 96/201] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:42 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:43.706383 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7008f970-ac4e-4187-bb57-dd340c9c53bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:43.707000 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7008f970-ac4e-4187-bb57-dd340c9c53bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:43.713135 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7008f970-ac4e-4187-bb57-dd340c9c53bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:43.713594 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7008f970-ac4e-4187-bb57-dd340c9c53bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:43.714389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7008f970-ac4e-4187-bb57-dd340c9c53bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:43.714892 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7008f970-ac4e-4187-bb57-dd340c9c53bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:43.859848 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7008f970-ac4e-4187-bb57-dd340c9c53bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:43.869745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7008f970-ac4e-4187-bb57-dd340c9c53bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:43.871286 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7008f970-ac4e-4187-bb57-dd340c9c53bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:43.872436 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7008f970-ac4e-4187-bb57-dd340c9c53bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1405 microversion: 2.20 time: 0.170562 May 12 14:32:43.873011 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 106/202] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:43 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:32:44.895603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e7cee8bb-615e-4546-b1a9-26a60062ba1b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:44.896240 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e7cee8bb-615e-4546-b1a9-26a60062ba1b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:44.902398 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e7cee8bb-615e-4546-b1a9-26a60062ba1b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:44.902988 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e7cee8bb-615e-4546-b1a9-26a60062ba1b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:44.904072 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e7cee8bb-615e-4546-b1a9-26a60062ba1b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:44.904681 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e7cee8bb-615e-4546-b1a9-26a60062ba1b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:45.140439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e7cee8bb-615e-4546-b1a9-26a60062ba1b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:45.149156 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e7cee8bb-615e-4546-b1a9-26a60062ba1b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:45.150666 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e7cee8bb-615e-4546-b1a9-26a60062ba1b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:32:45.151849 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e7cee8bb-615e-4546-b1a9-26a60062ba1b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1597 microversion: 2.20 time: 0.260419 May 12 14:32:45.152424 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 97/203] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:32:44 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1597 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:32:45.170922 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-efc5c6c9-cdc0-46aa-be62-1748f9e2f4da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:32:45.171867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-efc5c6c9-cdc0-46aa-be62-1748f9e2f4da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:45.177916 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-efc5c6c9-cdc0-46aa-be62-1748f9e2f4da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:45.178749 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-efc5c6c9-cdc0-46aa-be62-1748f9e2f4da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:45.179934 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-efc5c6c9-cdc0-46aa-be62-1748f9e2f4da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:45.180378 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-efc5c6c9-cdc0-46aa-be62-1748f9e2f4da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:45.308921 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-efc5c6c9-cdc0-46aa-be62-1748f9e2f4da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.141840 May 12 14:32:45.309941 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 107/204] 10.222.0.75 () {60 vars in 1315 bytes} [Thu May 12 14:32:45 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:32:46.524257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-574126e6-6b42-4b5a-bcc5-a4d0f44cb24d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4862070-1d1d-47b6-9e77-b1e92c614384"}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:32:46.525396 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-574126e6-6b42-4b5a-bcc5-a4d0f44cb24d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:32:46.533345 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-574126e6-6b42-4b5a-bcc5-a4d0f44cb24d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:46.534052 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-574126e6-6b42-4b5a-bcc5-a4d0f44cb24d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:46.535132 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-574126e6-6b42-4b5a-bcc5-a4d0f44cb24d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:46.535722 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-574126e6-6b42-4b5a-bcc5-a4d0f44cb24d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:46.572891 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-5e65fba4-105a-4db6-ba9b-e4b37645eb5c req-bb55f340-240f-4296-a3bc-ead4d010e176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e2a4c2-6255-4074-9a3c-e5159c3f7b87", "tag": "7fccb52d-a09a-4e64-adbe-8b42348d39c5"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:32:46.581150 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-5e65fba4-105a-4db6-ba9b-e4b37645eb5c req-bb55f340-240f-4296-a3bc-ead4d010e176 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:32:46.581593 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-5e65fba4-105a-4db6-ba9b-e4b37645eb5c req-bb55f340-240f-4296-a3bc-ead4d010e176 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:32:46.595017 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-5e65fba4-105a-4db6-ba9b-e4b37645eb5c req-bb55f340-240f-4296-a3bc-ead4d010e176 service nova] Creating event network-changed:7fccb52d-a09a-4e64-adbe-8b42348d39c5 for instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 on hv-cinder-77703 May 12 14:32:46.601276 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-5e65fba4-105a-4db6-ba9b-e4b37645eb5c req-bb55f340-240f-4296-a3bc-ead4d010e176 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031733 May 12 14:32:46.602316 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 108/205] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:32:47.000435 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-574126e6-6b42-4b5a-bcc5-a4d0f44cb24d tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "POST /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.480606 May 12 14:32:47.001850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 98/206] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 12 14:32:46 2022] POST /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:33:04.989086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-23b42f47-2cf1-4451-8d55-0db61bd49375 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:04.989697 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-23b42f47-2cf1-4451-8d55-0db61bd49375 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:05.009770 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-23b42f47-2cf1-4451-8d55-0db61bd49375 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:05.014531 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-23b42f47-2cf1-4451-8d55-0db61bd49375 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:05.015590 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-23b42f47-2cf1-4451-8d55-0db61bd49375 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:05.016047 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-23b42f47-2cf1-4451-8d55-0db61bd49375 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:05.115109 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-23b42f47-2cf1-4451-8d55-0db61bd49375 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Going to try to terminate instance {{(pid=118216) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:33:05.296887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-23b42f47-2cf1-4451-8d55-0db61bd49375 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 204 len: 0 microversion: 2.1 time: 0.312557 May 12 14:33:05.298048 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 109/207] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:33:04 2022] DELETE /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 14:33:05.311873 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-fb0c027a-6043-4051-87fa-e31985125f3b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:05.312728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-fb0c027a-6043-4051-87fa-e31985125f3b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:05.322625 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fb0c027a-6043-4051-87fa-e31985125f3b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:05.323298 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fb0c027a-6043-4051-87fa-e31985125f3b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:05.324105 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fb0c027a-6043-4051-87fa-e31985125f3b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:05.324555 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fb0c027a-6043-4051-87fa-e31985125f3b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:05.560251 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-fb0c027a-6043-4051-87fa-e31985125f3b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:05.569067 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-fb0c027a-6043-4051-87fa-e31985125f3b tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1554 microversion: 2.1 time: 0.262815 May 12 14:33:05.569958 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 99/208] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:05 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1554 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:06.589307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c5f7ed8f-ce4b-45bd-b3aa-6593f7e13212 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:06.590917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c5f7ed8f-ce4b-45bd-b3aa-6593f7e13212 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:06.597692 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c5f7ed8f-ce4b-45bd-b3aa-6593f7e13212 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:06.598245 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c5f7ed8f-ce4b-45bd-b3aa-6593f7e13212 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:06.599292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c5f7ed8f-ce4b-45bd-b3aa-6593f7e13212 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:06.599996 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c5f7ed8f-ce4b-45bd-b3aa-6593f7e13212 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:06.768539 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c5f7ed8f-ce4b-45bd-b3aa-6593f7e13212 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:06.778432 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c5f7ed8f-ce4b-45bd-b3aa-6593f7e13212 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1554 microversion: 2.1 time: 0.194090 May 12 14:33:06.779558 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 110/209] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:06 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:07.796598 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c72abb5c-ddc8-4c48-ba76-bdcf3821dcd2 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:07.798150 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c72abb5c-ddc8-4c48-ba76-bdcf3821dcd2 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:07.807700 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c72abb5c-ddc8-4c48-ba76-bdcf3821dcd2 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:07.808671 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c72abb5c-ddc8-4c48-ba76-bdcf3821dcd2 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:07.810686 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c72abb5c-ddc8-4c48-ba76-bdcf3821dcd2 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:07.811579 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c72abb5c-ddc8-4c48-ba76-bdcf3821dcd2 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:08.094516 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c72abb5c-ddc8-4c48-ba76-bdcf3821dcd2 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:08.103919 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c72abb5c-ddc8-4c48-ba76-bdcf3821dcd2 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1554 microversion: 2.1 time: 0.312169 May 12 14:33:08.104532 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 100/210] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:07 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1554 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:09.121124 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e7107a1e-109c-4e87-8b73-ea970855d230 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:09.122587 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e7107a1e-109c-4e87-8b73-ea970855d230 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:09.130387 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7107a1e-109c-4e87-8b73-ea970855d230 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:09.134615 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7107a1e-109c-4e87-8b73-ea970855d230 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:09.136052 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7107a1e-109c-4e87-8b73-ea970855d230 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:09.139784 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7107a1e-109c-4e87-8b73-ea970855d230 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:09.695510 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e7107a1e-109c-4e87-8b73-ea970855d230 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:09.712420 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e7107a1e-109c-4e87-8b73-ea970855d230 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1512 microversion: 2.1 time: 0.594785 May 12 14:33:09.716091 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 111/211] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:09 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1512 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:09.728924 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-df56958a-b4d0-4b22-b265-cebc589b13d7 req-579f3467-bc0f-4232-9b01-0437d98115fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b422890a-65ed-4ca3-b19c-ec9fbba5e813", "name": "network-vif-deleted", "tag": "5c15b5e9-eb16-450c-b4f2-aaddb6302fe6"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:33:09.745120 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-df56958a-b4d0-4b22-b265-cebc589b13d7 req-579f3467-bc0f-4232-9b01-0437d98115fb service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:09.745627 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-df56958a-b4d0-4b22-b265-cebc589b13d7 req-579f3467-bc0f-4232-9b01-0437d98115fb service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:09.761054 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-df56958a-b4d0-4b22-b265-cebc589b13d7 req-579f3467-bc0f-4232-9b01-0437d98115fb service nova] Creating event network-vif-deleted:5c15b5e9-eb16-450c-b4f2-aaddb6302fe6 for instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 on hv-cinder-77703 May 12 14:33:09.766888 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-df56958a-b4d0-4b22-b265-cebc589b13d7 req-579f3467-bc0f-4232-9b01-0437d98115fb service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044931 May 12 14:33:09.768228 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 101/212] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:33:10.732749 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-945483e3-1f4d-420a-8197-d305ce62361c tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:10.733481 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-945483e3-1f4d-420a-8197-d305ce62361c tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:10.745092 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-945483e3-1f4d-420a-8197-d305ce62361c tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:10.745554 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-945483e3-1f4d-420a-8197-d305ce62361c tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:10.760280 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-945483e3-1f4d-420a-8197-d305ce62361c tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:10.762025 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-945483e3-1f4d-420a-8197-d305ce62361c tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:10.883374 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-945483e3-1f4d-420a-8197-d305ce62361c tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:10.883924 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-945483e3-1f4d-420a-8197-d305ce62361c tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:10.884406 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-945483e3-1f4d-420a-8197-d305ce62361c tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lazy-loading 'fault' on Instance uuid b422890a-65ed-4ca3-b19c-ec9fbba5e813 {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:33:11.141692 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-945483e3-1f4d-420a-8197-d305ce62361c tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e59323f23bd40928544cfac604a5270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5595513cb114487cb476e609d069709b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:11.161985 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-945483e3-1f4d-420a-8197-d305ce62361c tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 200 len: 1305 microversion: 2.1 time: 0.423005 May 12 14:33:11.162959 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 112/213] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:10 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 1305 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:12.194467 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bc1eea8b-c416-450d-8147-61a95fe3fe9a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:12.199105 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bc1eea8b-c416-450d-8147-61a95fe3fe9a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:12.222419 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bc1eea8b-c416-450d-8147-61a95fe3fe9a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:12.222894 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bc1eea8b-c416-450d-8147-61a95fe3fe9a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:12.228629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bc1eea8b-c416-450d-8147-61a95fe3fe9a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:12.229124 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bc1eea8b-c416-450d-8147-61a95fe3fe9a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:12.280182 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-bc1eea8b-c416-450d-8147-61a95fe3fe9a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] HTTP exception thrown: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bc1eea8b-c416-450d-8147-61a95fe3fe9a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Request method failure captured: May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 HTTP/1.1 May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRo33rtNh_W65Cyx4QeaUhSqfsCkMJgY41eKWCHfKXe-yJwsTooI56IKocuHrrIq-ZZFfEJpK1HAQ9-w8Rnh9msY9D6AXo8b1Nsk0MD1ufVHklWuvU1_CXcY8KA-ZljGWcWtSAWRqnJp5TOl9v6LWR8TSrVWyiJ6J7Nrn8Drt6Yka-k May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 5595513cb114487cb476e609d069709b May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-DeleteServersTestJSON-1321142101 May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:33:12.287641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:33:12.289117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/5595513cb114487cb476e609d069709b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5595513cb114487cb476e609d069709b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_5595513cb114487cb476e609d069709b", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5595513cb114487cb476e609d069709b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:33:12.289117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-DeleteServersTestJSON-1321142101 May 12 14:33:12.289117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 5595513cb114487cb476e609d069709b May 12 14:33:12.289117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-DeleteServersTestJSON-1321142101 May 12 14:33:12.289117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-DeleteServersTestJSON-1321142101-project May 12 14:33:12.289117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:33:12.289117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:33:12.289117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: 1e59323f23bd40928544cfac604a5270 May 12 14:33:12.289117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-DeleteServersTestJSON-1321142101-project May 12 14:33:12.289117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:33:12.289117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:12.289117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': 'b422890a-65ed-4ca3-b19c-ec9fbba5e813'} May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:33:12.289813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:12.291777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:33:12.295148 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bc1eea8b-c416-450d-8147-61a95fe3fe9a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Returning 404 to user: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:33:12.300142 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bc1eea8b-c416-450d-8147-61a95fe3fe9a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 404 len: 111 microversion: 2.1 time: 0.122669 May 12 14:33:12.301506 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 102/214] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:12 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:33:12.545815 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b78209cb-d4de-4864-9a25-47883e2847c7 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:12.546870 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b78209cb-d4de-4864-9a25-47883e2847c7 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:12.556707 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b78209cb-d4de-4864-9a25-47883e2847c7 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:12.557164 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b78209cb-d4de-4864-9a25-47883e2847c7 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:12.557962 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b78209cb-d4de-4864-9a25-47883e2847c7 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:12.558401 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b78209cb-d4de-4864-9a25-47883e2847c7 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:12.606277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-b78209cb-d4de-4864-9a25-47883e2847c7 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] HTTP exception thrown: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b78209cb-d4de-4864-9a25-47883e2847c7 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Request method failure captured: May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813/os-volume_attachments HTTP/1.1 May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRo33rtNh_W65Cyx4QeaUhSqfsCkMJgY41eKWCHfKXe-yJwsTooI56IKocuHrrIq-ZZFfEJpK1HAQ9-w8Rnh9msY9D6AXo8b1Nsk0MD1ufVHklWuvU1_CXcY8KA-ZljGWcWtSAWRqnJp5TOl9v6LWR8TSrVWyiJ6J7Nrn8Drt6Yka-k May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 5595513cb114487cb476e609d069709b May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-DeleteServersTestJSON-1321142101 May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:33:12.624496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:33:12.625827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/5595513cb114487cb476e609d069709b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5595513cb114487cb476e609d069709b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_5595513cb114487cb476e609d069709b", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5595513cb114487cb476e609d069709b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:33:12.625827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-DeleteServersTestJSON-1321142101 May 12 14:33:12.625827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 5595513cb114487cb476e609d069709b May 12 14:33:12.625827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-DeleteServersTestJSON-1321142101 May 12 14:33:12.625827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-DeleteServersTestJSON-1321142101-project May 12 14:33:12.625827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:33:12.625827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:33:12.625827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: 1e59323f23bd40928544cfac604a5270 May 12 14:33:12.625827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-DeleteServersTestJSON-1321142101-project May 12 14:33:12.625827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:33:12.625827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:12.625827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'server_id': 'b422890a-65ed-4ca3-b19c-ec9fbba5e813'} May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:33:12.626917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:12.629360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:33:12.631577 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b78209cb-d4de-4864-9a25-47883e2847c7 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Returning 404 to user: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:33:12.632076 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b78209cb-d4de-4864-9a25-47883e2847c7 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.089841 May 12 14:33:12.633472 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 113/215] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:33:12 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813/os-volume_attachments => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:33:14.057983 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2488c80d-819b-481e-bf8c-26813828c169 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:14.058569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2488c80d-819b-481e-bf8c-26813828c169 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:14.076269 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2488c80d-819b-481e-bf8c-26813828c169 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:14.079676 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2488c80d-819b-481e-bf8c-26813828c169 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:14.080917 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2488c80d-819b-481e-bf8c-26813828c169 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:14.082694 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2488c80d-819b-481e-bf8c-26813828c169 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:14.121275 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-2488c80d-819b-481e-bf8c-26813828c169 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] HTTP exception thrown: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2488c80d-819b-481e-bf8c-26813828c169 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Request method failure captured: May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: DELETE /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 HTTP/1.1 May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRo33rtNh_W65Cyx4QeaUhSqfsCkMJgY41eKWCHfKXe-yJwsTooI56IKocuHrrIq-ZZFfEJpK1HAQ9-w8Rnh9msY9D6AXo8b1Nsk0MD1ufVHklWuvU1_CXcY8KA-ZljGWcWtSAWRqnJp5TOl9v6LWR8TSrVWyiJ6J7Nrn8Drt6Yka-k May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 5595513cb114487cb476e609d069709b May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-DeleteServersTestJSON-1321142101 May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:33:14.123131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:33:14.124354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/5595513cb114487cb476e609d069709b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5595513cb114487cb476e609d069709b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_5595513cb114487cb476e609d069709b", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5595513cb114487cb476e609d069709b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:33:14.124354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-DeleteServersTestJSON-1321142101 May 12 14:33:14.124354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 5595513cb114487cb476e609d069709b May 12 14:33:14.124354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-DeleteServersTestJSON-1321142101 May 12 14:33:14.124354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-DeleteServersTestJSON-1321142101-project May 12 14:33:14.124354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:33:14.124354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:33:14.124354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: 1e59323f23bd40928544cfac604a5270 May 12 14:33:14.124354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-DeleteServersTestJSON-1321142101-project May 12 14:33:14.124354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:33:14.124354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:14.124354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': 'b422890a-65ed-4ca3-b19c-ec9fbba5e813'} May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:33:14.125051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:14.126634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:33:14.127761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2488c80d-819b-481e-bf8c-26813828c169 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Returning 404 to user: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:33:14.127761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2488c80d-819b-481e-bf8c-26813828c169 tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 404 len: 111 microversion: 2.1 time: 0.071850 May 12 14:33:14.127761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 103/216] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:33:14 2022] DELETE /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:33:14.133865 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9605f08b-168e-42cd-94b9-e89310e2543a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:14.137896 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9605f08b-168e-42cd-94b9-e89310e2543a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] [instance: b422890a-65ed-4ca3-b19c-ec9fbba5e813] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:14.151119 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9605f08b-168e-42cd-94b9-e89310e2543a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:14.151568 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9605f08b-168e-42cd-94b9-e89310e2543a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:14.157251 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9605f08b-168e-42cd-94b9-e89310e2543a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:14.157832 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9605f08b-168e-42cd-94b9-e89310e2543a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:14.190909 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-9605f08b-168e-42cd-94b9-e89310e2543a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] HTTP exception thrown: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9605f08b-168e-42cd-94b9-e89310e2543a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Request method failure captured: May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 HTTP/1.1 May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRo33rtNh_W65Cyx4QeaUhSqfsCkMJgY41eKWCHfKXe-yJwsTooI56IKocuHrrIq-ZZFfEJpK1HAQ9-w8Rnh9msY9D6AXo8b1Nsk0MD1ufVHklWuvU1_CXcY8KA-ZljGWcWtSAWRqnJp5TOl9v6LWR8TSrVWyiJ6J7Nrn8Drt6Yka-k May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 5595513cb114487cb476e609d069709b May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-DeleteServersTestJSON-1321142101 May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:33:14.193307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:33:14.194705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/5595513cb114487cb476e609d069709b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5595513cb114487cb476e609d069709b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_5595513cb114487cb476e609d069709b", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5595513cb114487cb476e609d069709b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:33:14.194705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-DeleteServersTestJSON-1321142101 May 12 14:33:14.194705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 5595513cb114487cb476e609d069709b May 12 14:33:14.194705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-DeleteServersTestJSON-1321142101 May 12 14:33:14.194705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-DeleteServersTestJSON-1321142101-project May 12 14:33:14.194705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:33:14.194705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:33:14.194705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: 1e59323f23bd40928544cfac604a5270 May 12 14:33:14.194705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-DeleteServersTestJSON-1321142101-project May 12 14:33:14.194705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:33:14.194705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:14.194705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': 'b422890a-65ed-4ca3-b19c-ec9fbba5e813'} May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:33:14.195390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. May 12 14:33:14.196616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:33:14.202854 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9605f08b-168e-42cd-94b9-e89310e2543a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] Returning 404 to user: Instance b422890a-65ed-4ca3-b19c-ec9fbba5e813 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:33:14.203998 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9605f08b-168e-42cd-94b9-e89310e2543a tempest-DeleteServersTestJSON-1321142101 tempest-DeleteServersTestJSON-1321142101-project] 10.222.0.75 "GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813" status: 404 len: 111 microversion: 2.1 time: 0.074328 May 12 14:33:14.210304 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 114/217] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:14 2022] GET /compute/v2.1/servers/b422890a-65ed-4ca3-b19c-ec9fbba5e813 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:33:15.785942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1a049215-e523-45ae-a64e-4791bfcac275 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Action: 'create', calling method: .version_select at 0x7f5b26ae1670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-349363195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmvopFTHiPAWJqwzkgIYfUTD4A2Q959C0U+BSa0uoG4hZjZ/T1wd6xMgJWzMibZyrpCQZUhnaNZ0xuec0pk085l0200t0CzUUX0bnDB84dkfqzYaDWBp12Yq+rPOdJUrA=="}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:33:15.818417 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-1a049215-e523-45ae-a64e-4791bfcac275 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Getting quotas for project 0ba0ea753bb0496cbf274e802f50dd0e. Resources: {'key_pairs'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:33:15.830534 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-1a049215-e523-45ae-a64e-4791bfcac275 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Getting quotas for user a64c3ea69151401897e4203095676543 and project 0ba0ea753bb0496cbf274e802f50dd0e. Resources: {'key_pairs'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:33:15.893414 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1a049215-e523-45ae-a64e-4791bfcac275 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.535000 May 12 14:33:15.894093 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 104/218] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 12 14:33:15 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:33:19.540738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-945655936", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "networks": [{"uuid": "c4e4c52c-dcb8-4f29-b913-b6c0c789c55d"}]}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:33:23.873141 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-26839460", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452"}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:33:32.770277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.network.neutron [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] validate_networks() for [('c4e4c52c-dcb8-4f29-b913-b6c0c789c55d', None, None, None, None, None)] {{(pid=118216) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:33:32.773914 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.network.neutron [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] validate_networks() for None {{(pid=118217) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:33:33.452937 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Flavor limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:33:33.453370 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Image limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:33:33.453845 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Flavor pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:33:33.454257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Image pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:33:33.454673 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:33:33.467081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:33.467573 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:33.468448 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:33.468888 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:33.486664 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Getting quotas for project 2089564feda44bac86715eed2cf285f1. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:33:33.498428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Getting quotas for user 34b98d85325b4ea194c06848e508ad7a and project 2089564feda44bac86715eed2cf285f1. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:33:33.511126 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Going to run 1 instances... {{(pid=118217) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:33:33.513622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:33:33.572938 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1214758d-4c75-40a0-bde7-857a12b4af65 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.704300 May 12 14:33:33.573576 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 105/219] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:33:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 9709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 14:33:33.636271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Flavor limits 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:33:33.636680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Image limits 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:33:33.637159 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Flavor pref 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:33:33.637601 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Image pref 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:33:33.638025 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:33:33.648182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:33.648634 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:33.649722 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:33.650419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:33.669165 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Getting quotas for project a9501c41f0664eca9177e0071bb5b1b8. Resources: {'cores', 'instances', 'ram'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:33:33.674255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Getting quotas for user e6fa3252d9f04964b481dd02b378d072 and project a9501c41f0664eca9177e0071bb5b1b8. Resources: {'cores', 'instances', 'ram'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:33:33.685887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Going to run 1 instances... {{(pid=118216) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:33:33.688438 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:33:33.742247 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1651680801", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:33:33.770141 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4c9aa98d-49a4-48f5-b82d-bbfa215650a1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.233500 May 12 14:33:33.778521 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 115/220] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:33:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 14243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:33:33.794488 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0d34c2ad-16e0-461d-b0dd-ffda1a1b3919 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:33.795622 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0d34c2ad-16e0-461d-b0dd-ffda1a1b3919 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:33.818540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.network.neutron [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] validate_networks() for [('a960421c-0ac7-4777-ad11-86ea1221dbd0', None, None, None, None, None)] {{(pid=118217) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:33:33.868790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0d34c2ad-16e0-461d-b0dd-ffda1a1b3919 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:33.878841 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0d34c2ad-16e0-461d-b0dd-ffda1a1b3919 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1213 microversion: 2.1 time: 0.090953 May 12 14:33:33.890210 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 116/221] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:33 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:33.890804 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1dee6cbc-ef3b-4002-98f5-066a9afdd1eb tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:33.891385 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1dee6cbc-ef3b-4002-98f5-066a9afdd1eb tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:34.021515 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1dee6cbc-ef3b-4002-98f5-066a9afdd1eb tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:34.036035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1dee6cbc-ef3b-4002-98f5-066a9afdd1eb tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1218 microversion: 2.1 time: 0.154901 May 12 14:33:34.036686 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 117/222] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:33 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:34.345203 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Flavor limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:33:34.346298 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Image limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:33:34.347453 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Flavor pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:33:34.348264 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Image pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:33:34.349122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:33:34.367798 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:34.369589 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:34.372788 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:34.373440 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:34.402023 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Getting quotas for project 3c83c8fa2cd44eab84cb50b3ad06a1d3. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:33:34.408053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Getting quotas for user 2cfa47f1da4e4ae9a358e2b8ace795ac and project 3c83c8fa2cd44eab84cb50b3ad06a1d3. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:33:34.432967 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Going to run 1 instances... {{(pid=118217) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:33:34.440839 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:33:34.495626 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a6e88907-3984-4ef2-ac88-bea7f83d5a24 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.920663 May 12 14:33:34.496222 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 106/223] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:33:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:33:34.513451 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-82f02513-5516-49bd-b4e3-d0459391275c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:34.514511 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-82f02513-5516-49bd-b4e3-d0459391275c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:34.576258 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-82f02513-5516-49bd-b4e3-d0459391275c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:34.590888 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-82f02513-5516-49bd-b4e3-d0459391275c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1222 microversion: 2.1 time: 0.083882 May 12 14:33:34.592424 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 118/224] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:34 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:34.655264 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-533652648", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:33:34.748234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.network.neutron [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] validate_networks() for [('a960421c-0ac7-4777-ad11-86ea1221dbd0', None, None, None, None, None)] {{(pid=118217) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:33:34.898454 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a6444ece-0669-48f6-924f-3e19ebd13e55 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:34.899209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a6444ece-0669-48f6-924f-3e19ebd13e55 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:34.911499 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a6444ece-0669-48f6-924f-3e19ebd13e55 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:34.912040 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a6444ece-0669-48f6-924f-3e19ebd13e55 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:34.914369 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a6444ece-0669-48f6-924f-3e19ebd13e55 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:34.915228 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a6444ece-0669-48f6-924f-3e19ebd13e55 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:35.053948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a6444ece-0669-48f6-924f-3e19ebd13e55 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:35.061519 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a6444ece-0669-48f6-924f-3e19ebd13e55 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1273 microversion: 2.1 time: 0.167400 May 12 14:33:35.062320 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 119/225] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:34 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:35.068303 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-89a95c25-5bbc-41b0-89bd-63497d3777de tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:35.068907 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-89a95c25-5bbc-41b0-89bd-63497d3777de tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:35.074931 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-89a95c25-5bbc-41b0-89bd-63497d3777de tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:35.075422 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-89a95c25-5bbc-41b0-89bd-63497d3777de tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:35.076211 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-89a95c25-5bbc-41b0-89bd-63497d3777de tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:35.076651 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-89a95c25-5bbc-41b0-89bd-63497d3777de tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:35.174850 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-89a95c25-5bbc-41b0-89bd-63497d3777de tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:35.183996 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-89a95c25-5bbc-41b0-89bd-63497d3777de tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1270 microversion: 2.1 time: 0.120439 May 12 14:33:35.184580 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 120/226] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:35 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1270 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:35.421568 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Flavor limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:33:35.422081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Image limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:33:35.423388 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Flavor pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:33:35.429380 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Image pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:33:35.429901 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:33:35.440826 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:35.441276 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:35.442097 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:35.442541 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:35.466220 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Getting quotas for project 3c83c8fa2cd44eab84cb50b3ad06a1d3. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:33:35.471535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Getting quotas for user 2cfa47f1da4e4ae9a358e2b8ace795ac and project 3c83c8fa2cd44eab84cb50b3ad06a1d3. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:33:35.484711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Going to run 1 instances... {{(pid=118217) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:33:35.486942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:33:35.535737 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-27f13d4b-b793-463c-9d25-c1f45718870f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.884776 May 12 14:33:35.536456 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 107/227] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:33:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:33:35.546972 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-82c450b0-9604-44a0-a734-68f9f941355f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:35.547801 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-82c450b0-9604-44a0-a734-68f9f941355f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:35.629303 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-82c450b0-9604-44a0-a734-68f9f941355f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:35.639231 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-82c450b0-9604-44a0-a734-68f9f941355f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1221 microversion: 2.1 time: 0.096003 May 12 14:33:35.640334 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 121/228] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:35 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:36.080103 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1259c2b8-682d-4e33-b450-9c76262d7375 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:36.081026 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1259c2b8-682d-4e33-b450-9c76262d7375 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:36.088697 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1259c2b8-682d-4e33-b450-9c76262d7375 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:36.088697 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1259c2b8-682d-4e33-b450-9c76262d7375 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:36.091247 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1259c2b8-682d-4e33-b450-9c76262d7375 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:36.091247 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1259c2b8-682d-4e33-b450-9c76262d7375 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:36.205622 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2675a241-9198-4b60-bf64-f74bf5f4d60a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:36.206886 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2675a241-9198-4b60-bf64-f74bf5f4d60a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:36.219630 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2675a241-9198-4b60-bf64-f74bf5f4d60a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:36.220077 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2675a241-9198-4b60-bf64-f74bf5f4d60a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:36.221700 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2675a241-9198-4b60-bf64-f74bf5f4d60a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:36.222304 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2675a241-9198-4b60-bf64-f74bf5f4d60a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:36.223868 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1259c2b8-682d-4e33-b450-9c76262d7375 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:36.249756 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1259c2b8-682d-4e33-b450-9c76262d7375 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1271 microversion: 2.1 time: 0.173918 May 12 14:33:36.250442 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 108/229] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:36 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:36.330477 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2675a241-9198-4b60-bf64-f74bf5f4d60a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:36.338301 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2675a241-9198-4b60-bf64-f74bf5f4d60a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1276 microversion: 2.1 time: 0.139169 May 12 14:33:36.338982 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 122/230] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:36 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:36.656655 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8b151291-1f6a-4a20-aedc-b006e492f960 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:36.657972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8b151291-1f6a-4a20-aedc-b006e492f960 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:36.664710 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b151291-1f6a-4a20-aedc-b006e492f960 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:36.665068 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b151291-1f6a-4a20-aedc-b006e492f960 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:36.665863 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b151291-1f6a-4a20-aedc-b006e492f960 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:36.666497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b151291-1f6a-4a20-aedc-b006e492f960 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:37.006041 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8b151291-1f6a-4a20-aedc-b006e492f960 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:37.014660 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8b151291-1f6a-4a20-aedc-b006e492f960 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1273 microversion: 2.1 time: 0.362204 May 12 14:33:37.016008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 109/231] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:36 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1273 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:37.278730 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ad353803-2982-4a6e-9f9a-ee8891ebabc9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:37.278730 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ad353803-2982-4a6e-9f9a-ee8891ebabc9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:37.301317 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ad353803-2982-4a6e-9f9a-ee8891ebabc9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:37.302301 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ad353803-2982-4a6e-9f9a-ee8891ebabc9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:37.303241 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ad353803-2982-4a6e-9f9a-ee8891ebabc9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:37.303884 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ad353803-2982-4a6e-9f9a-ee8891ebabc9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:37.356766 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-fa0da652-ba16-4062-9af1-5d104d5db266 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:37.357397 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-fa0da652-ba16-4062-9af1-5d104d5db266 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:37.368647 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fa0da652-ba16-4062-9af1-5d104d5db266 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:37.369482 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fa0da652-ba16-4062-9af1-5d104d5db266 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:37.370744 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fa0da652-ba16-4062-9af1-5d104d5db266 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:37.371521 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fa0da652-ba16-4062-9af1-5d104d5db266 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:37.526427 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-fa0da652-ba16-4062-9af1-5d104d5db266 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:37.535449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-fa0da652-ba16-4062-9af1-5d104d5db266 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1276 microversion: 2.1 time: 0.182341 May 12 14:33:37.536069 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 110/232] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:37 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1276 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:37.720860 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ad353803-2982-4a6e-9f9a-ee8891ebabc9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:37.731382 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ad353803-2982-4a6e-9f9a-ee8891ebabc9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.464439 May 12 14:33:37.732210 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 123/233] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:37 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:38.036605 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-af43f6bb-a8e6-453a-8e77-9d9632653369 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:38.039086 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-af43f6bb-a8e6-453a-8e77-9d9632653369 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:38.054079 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-af43f6bb-a8e6-453a-8e77-9d9632653369 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:38.055336 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-af43f6bb-a8e6-453a-8e77-9d9632653369 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:38.057482 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-af43f6bb-a8e6-453a-8e77-9d9632653369 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:38.058392 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-af43f6bb-a8e6-453a-8e77-9d9632653369 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:38.229460 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-af43f6bb-a8e6-453a-8e77-9d9632653369 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:38.239347 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-af43f6bb-a8e6-453a-8e77-9d9632653369 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1279 microversion: 2.1 time: 0.210366 May 12 14:33:38.240106 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 111/234] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:38 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1279 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:38.552782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b1883ee4-c5b8-4e81-95fe-817a7784237f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:38.559816 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b1883ee4-c5b8-4e81-95fe-817a7784237f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:38.575541 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-0fa340e4-dab1-4806-914f-dcde0dc5698d req-0cd0186e-f3bf-407d-9218-a65119697437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8855245c-3865-4c1b-8dd4-da43c780113e", "tag": "f636a2b1-87e8-46f9-b1ec-23fa693c4a57"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:33:38.577054 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b1883ee4-c5b8-4e81-95fe-817a7784237f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:38.582891 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b1883ee4-c5b8-4e81-95fe-817a7784237f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:38.584363 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b1883ee4-c5b8-4e81-95fe-817a7784237f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:38.585089 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b1883ee4-c5b8-4e81-95fe-817a7784237f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:38.612973 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-0fa340e4-dab1-4806-914f-dcde0dc5698d req-0cd0186e-f3bf-407d-9218-a65119697437 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:38.613788 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-0fa340e4-dab1-4806-914f-dcde0dc5698d req-0cd0186e-f3bf-407d-9218-a65119697437 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:38.667113 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-0fa340e4-dab1-4806-914f-dcde0dc5698d req-0cd0186e-f3bf-407d-9218-a65119697437 service nova] Creating event network-changed:f636a2b1-87e8-46f9-b1ec-23fa693c4a57 for instance 8855245c-3865-4c1b-8dd4-da43c780113e on hv-cinder-77703 May 12 14:33:38.675435 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-0fa340e4-dab1-4806-914f-dcde0dc5698d req-0cd0186e-f3bf-407d-9218-a65119697437 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102983 May 12 14:33:38.677859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 112/235] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:33:38.752417 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-10411baa-dba7-44db-b467-5ec5325fd015 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:38.753451 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-10411baa-dba7-44db-b467-5ec5325fd015 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:38.762170 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-10411baa-dba7-44db-b467-5ec5325fd015 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:38.762849 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-10411baa-dba7-44db-b467-5ec5325fd015 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:38.763890 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-10411baa-dba7-44db-b467-5ec5325fd015 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:38.764497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-10411baa-dba7-44db-b467-5ec5325fd015 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:39.186917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b1883ee4-c5b8-4e81-95fe-817a7784237f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:39.201723 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b1883ee4-c5b8-4e81-95fe-817a7784237f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.653198 May 12 14:33:39.205754 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 124/236] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:38 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:39.211419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-641c38b6-e82d-4432-8213-5e788041a7ea req-f535136b-024c-4d0e-b483-2d2c45029801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c5ced7e-9d8b-4d24-a35d-876326b483ba", "tag": "62f6a176-00c7-4955-ac5a-e84fb95f6c3d"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:33:39.228066 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-641c38b6-e82d-4432-8213-5e788041a7ea req-f535136b-024c-4d0e-b483-2d2c45029801 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:39.228975 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-641c38b6-e82d-4432-8213-5e788041a7ea req-f535136b-024c-4d0e-b483-2d2c45029801 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:39.242230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-641c38b6-e82d-4432-8213-5e788041a7ea req-f535136b-024c-4d0e-b483-2d2c45029801 service nova] Creating event network-changed:62f6a176-00c7-4955-ac5a-e84fb95f6c3d for instance 5c5ced7e-9d8b-4d24-a35d-876326b483ba on hv-cinder-77703 May 12 14:33:39.249494 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-641c38b6-e82d-4432-8213-5e788041a7ea req-f535136b-024c-4d0e-b483-2d2c45029801 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042124 May 12 14:33:39.252651 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 125/237] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:33:39.259373 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1d388c0c-3ffc-452a-a413-50efb441efa2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:39.260704 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1d388c0c-3ffc-452a-a413-50efb441efa2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:39.268478 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1d388c0c-3ffc-452a-a413-50efb441efa2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:39.269503 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1d388c0c-3ffc-452a-a413-50efb441efa2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:39.270562 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1d388c0c-3ffc-452a-a413-50efb441efa2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:39.271322 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1d388c0c-3ffc-452a-a413-50efb441efa2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:39.281846 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-10411baa-dba7-44db-b467-5ec5325fd015 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:39.296509 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-10411baa-dba7-44db-b467-5ec5325fd015 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.551737 May 12 14:33:39.297466 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 113/238] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:38 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:39.380245 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1d388c0c-3ffc-452a-a413-50efb441efa2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:39.401240 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1d388c0c-3ffc-452a-a413-50efb441efa2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1279 microversion: 2.1 time: 0.145730 May 12 14:33:39.403254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 126/239] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:39 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1279 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:40.228559 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b9b43ca2-abc2-43a0-9b16-c25b09d55276 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:40.229180 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b9b43ca2-abc2-43a0-9b16-c25b09d55276 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:40.236542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9b43ca2-abc2-43a0-9b16-c25b09d55276 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:40.237004 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9b43ca2-abc2-43a0-9b16-c25b09d55276 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:40.237798 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9b43ca2-abc2-43a0-9b16-c25b09d55276 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:40.238244 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9b43ca2-abc2-43a0-9b16-c25b09d55276 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:40.313138 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-24aa954c-e3c5-4999-934e-1e260cea8b58 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:40.313822 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-24aa954c-e3c5-4999-934e-1e260cea8b58 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:40.320128 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-24aa954c-e3c5-4999-934e-1e260cea8b58 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:40.320787 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-24aa954c-e3c5-4999-934e-1e260cea8b58 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:40.321768 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-24aa954c-e3c5-4999-934e-1e260cea8b58 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:40.322369 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-24aa954c-e3c5-4999-934e-1e260cea8b58 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:40.401459 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b9b43ca2-abc2-43a0-9b16-c25b09d55276 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:40.409883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b9b43ca2-abc2-43a0-9b16-c25b09d55276 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.185206 May 12 14:33:40.410469 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 114/240] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:40 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:40.420699 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ca79e70a-30d3-4ba9-b747-ac1e7ef74db8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:40.421313 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ca79e70a-30d3-4ba9-b747-ac1e7ef74db8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:40.427484 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ca79e70a-30d3-4ba9-b747-ac1e7ef74db8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:40.428148 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ca79e70a-30d3-4ba9-b747-ac1e7ef74db8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:40.428935 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ca79e70a-30d3-4ba9-b747-ac1e7ef74db8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:40.429375 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ca79e70a-30d3-4ba9-b747-ac1e7ef74db8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:40.474780 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-24aa954c-e3c5-4999-934e-1e260cea8b58 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:40.482448 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-24aa954c-e3c5-4999-934e-1e260cea8b58 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.173168 May 12 14:33:40.483057 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 127/241] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:40 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:40.580379 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ca79e70a-30d3-4ba9-b747-ac1e7ef74db8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:40.587757 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ca79e70a-30d3-4ba9-b747-ac1e7ef74db8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.170760 May 12 14:33:40.588339 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 115/242] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:40 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:40.709262 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-35dd2997-79e5-4598-9721-328e407d0616 req-5f694696-2d9c-4486-8151-b4f243e6582f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0d59a6-8822-4d8d-83c9-390537c9818a", "tag": "03346ca6-97d2-422d-8314-1e57b404e30b"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:33:40.717368 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-35dd2997-79e5-4598-9721-328e407d0616 req-5f694696-2d9c-4486-8151-b4f243e6582f service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:40.717815 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-35dd2997-79e5-4598-9721-328e407d0616 req-5f694696-2d9c-4486-8151-b4f243e6582f service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:40.729718 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-35dd2997-79e5-4598-9721-328e407d0616 req-5f694696-2d9c-4486-8151-b4f243e6582f service nova] Creating event network-changed:03346ca6-97d2-422d-8314-1e57b404e30b for instance 7f0d59a6-8822-4d8d-83c9-390537c9818a on hv-cinder-77703 May 12 14:33:40.734670 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-35dd2997-79e5-4598-9721-328e407d0616 req-5f694696-2d9c-4486-8151-b4f243e6582f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029049 May 12 14:33:40.735316 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 128/243] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:33:41.427423 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5e3b68fb-e5c0-41cc-9ca8-f11e595de2dd tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:41.428047 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5e3b68fb-e5c0-41cc-9ca8-f11e595de2dd tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:41.434594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5e3b68fb-e5c0-41cc-9ca8-f11e595de2dd tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:41.435073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5e3b68fb-e5c0-41cc-9ca8-f11e595de2dd tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:41.435866 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5e3b68fb-e5c0-41cc-9ca8-f11e595de2dd tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:41.436309 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5e3b68fb-e5c0-41cc-9ca8-f11e595de2dd tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:41.500063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-86d33616-bc8f-4754-b15b-22ac5a1309a1 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:41.500702 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-86d33616-bc8f-4754-b15b-22ac5a1309a1 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:41.508459 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-86d33616-bc8f-4754-b15b-22ac5a1309a1 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:41.508941 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-86d33616-bc8f-4754-b15b-22ac5a1309a1 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:41.509784 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-86d33616-bc8f-4754-b15b-22ac5a1309a1 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:41.510222 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-86d33616-bc8f-4754-b15b-22ac5a1309a1 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:41.607669 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5e3b68fb-e5c0-41cc-9ca8-f11e595de2dd tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:41.617304 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5e3b68fb-e5c0-41cc-9ca8-f11e595de2dd tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.193950 May 12 14:33:41.617823 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 116/244] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:41 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:41.622520 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c4970ae1-e54b-4769-9aa1-0aec933392ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:41.623736 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c4970ae1-e54b-4769-9aa1-0aec933392ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:41.634181 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c4970ae1-e54b-4769-9aa1-0aec933392ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:41.634970 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c4970ae1-e54b-4769-9aa1-0aec933392ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:41.635821 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c4970ae1-e54b-4769-9aa1-0aec933392ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:41.636269 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c4970ae1-e54b-4769-9aa1-0aec933392ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:41.684244 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-86d33616-bc8f-4754-b15b-22ac5a1309a1 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:41.692315 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-86d33616-bc8f-4754-b15b-22ac5a1309a1 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.196487 May 12 14:33:41.692917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 129/245] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:41 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:41.786922 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c4970ae1-e54b-4769-9aa1-0aec933392ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:41.794838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c4970ae1-e54b-4769-9aa1-0aec933392ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.175874 May 12 14:33:41.795510 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 117/246] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:41 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:42.635760 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-defaa94d-ddbd-434c-b5d8-a927cc41df1f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:42.636404 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-defaa94d-ddbd-434c-b5d8-a927cc41df1f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:42.643077 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-defaa94d-ddbd-434c-b5d8-a927cc41df1f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:42.643528 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-defaa94d-ddbd-434c-b5d8-a927cc41df1f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:42.644324 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-defaa94d-ddbd-434c-b5d8-a927cc41df1f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:42.644738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-defaa94d-ddbd-434c-b5d8-a927cc41df1f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:42.709749 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5b019414-fd72-4ae7-9ec5-39b4ad4a7fa9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:42.710315 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5b019414-fd72-4ae7-9ec5-39b4ad4a7fa9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:42.716956 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5b019414-fd72-4ae7-9ec5-39b4ad4a7fa9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:42.717416 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5b019414-fd72-4ae7-9ec5-39b4ad4a7fa9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:42.718226 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5b019414-fd72-4ae7-9ec5-39b4ad4a7fa9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:42.718637 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5b019414-fd72-4ae7-9ec5-39b4ad4a7fa9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:42.819635 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-defaa94d-ddbd-434c-b5d8-a927cc41df1f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:42.827371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-defaa94d-ddbd-434c-b5d8-a927cc41df1f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.195425 May 12 14:33:42.827958 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 130/247] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:42 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:42.832844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-70a2b8fb-0954-4e67-8132-4d6c0498364f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:42.833450 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-70a2b8fb-0954-4e67-8132-4d6c0498364f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:42.839983 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-70a2b8fb-0954-4e67-8132-4d6c0498364f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:42.840700 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-70a2b8fb-0954-4e67-8132-4d6c0498364f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:42.841483 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-70a2b8fb-0954-4e67-8132-4d6c0498364f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:42.841918 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-70a2b8fb-0954-4e67-8132-4d6c0498364f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:42.866711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5b019414-fd72-4ae7-9ec5-39b4ad4a7fa9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:42.874743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5b019414-fd72-4ae7-9ec5-39b4ad4a7fa9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.169069 May 12 14:33:42.875382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 118/248] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:42 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:42.980779 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-70a2b8fb-0954-4e67-8132-4d6c0498364f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:42.988740 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-70a2b8fb-0954-4e67-8132-4d6c0498364f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.159482 May 12 14:33:42.989330 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 131/249] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:42 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:43.848064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2b9e23a4-00dd-45be-97c9-45a5b2319196 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:43.849804 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2b9e23a4-00dd-45be-97c9-45a5b2319196 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:43.857911 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2b9e23a4-00dd-45be-97c9-45a5b2319196 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:43.858367 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2b9e23a4-00dd-45be-97c9-45a5b2319196 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:43.859183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2b9e23a4-00dd-45be-97c9-45a5b2319196 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:43.859697 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2b9e23a4-00dd-45be-97c9-45a5b2319196 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:43.892504 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a52b96e0-78c9-456b-b1fe-d1bf1ad00313 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:43.893306 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a52b96e0-78c9-456b-b1fe-d1bf1ad00313 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:43.899734 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a52b96e0-78c9-456b-b1fe-d1bf1ad00313 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:43.900544 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a52b96e0-78c9-456b-b1fe-d1bf1ad00313 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:43.901701 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a52b96e0-78c9-456b-b1fe-d1bf1ad00313 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:43.902374 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a52b96e0-78c9-456b-b1fe-d1bf1ad00313 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:44.299679 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a52b96e0-78c9-456b-b1fe-d1bf1ad00313 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:44.306989 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a52b96e0-78c9-456b-b1fe-d1bf1ad00313 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.418427 May 12 14:33:44.307592 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 132/250] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:43 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:44.314591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a176c067-e459-4f34-aed0-f2897ef1c1a7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:44.315642 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a176c067-e459-4f34-aed0-f2897ef1c1a7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:44.322845 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2b9e23a4-00dd-45be-97c9-45a5b2319196 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:44.326457 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a176c067-e459-4f34-aed0-f2897ef1c1a7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:44.327220 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a176c067-e459-4f34-aed0-f2897ef1c1a7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:44.328574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a176c067-e459-4f34-aed0-f2897ef1c1a7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:44.329816 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a176c067-e459-4f34-aed0-f2897ef1c1a7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:44.340677 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2b9e23a4-00dd-45be-97c9-45a5b2319196 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.498789 May 12 14:33:44.343212 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 119/251] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:43 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:44.572853 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a176c067-e459-4f34-aed0-f2897ef1c1a7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:44.581050 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a176c067-e459-4f34-aed0-f2897ef1c1a7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.272324 May 12 14:33:44.581642 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 133/252] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:44 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:44.940908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-8f1eb39f-3b42-451d-bd16-ddc4a5e7ca89 req-d04db475-09c8-4ee3-a15b-4eb9e30b718f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137403bd-302f-4ea4-aeba-782ade2358e0", "tag": "edce530e-0a2a-4073-b478-f2228ceb37bc"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:33:44.950486 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-8f1eb39f-3b42-451d-bd16-ddc4a5e7ca89 req-d04db475-09c8-4ee3-a15b-4eb9e30b718f service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:44.950941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-8f1eb39f-3b42-451d-bd16-ddc4a5e7ca89 req-d04db475-09c8-4ee3-a15b-4eb9e30b718f service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:44.970059 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-8f1eb39f-3b42-451d-bd16-ddc4a5e7ca89 req-d04db475-09c8-4ee3-a15b-4eb9e30b718f service nova] Creating event network-changed:edce530e-0a2a-4073-b478-f2228ceb37bc for instance 137403bd-302f-4ea4-aeba-782ade2358e0 on hv-cinder-77703 May 12 14:33:44.975607 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-8f1eb39f-3b42-451d-bd16-ddc4a5e7ca89 req-d04db475-09c8-4ee3-a15b-4eb9e30b718f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038936 May 12 14:33:44.976492 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 120/253] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:33:45.325432 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-34120e20-e76b-49cd-a3a7-4deaecb5421a tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:45.326043 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-34120e20-e76b-49cd-a3a7-4deaecb5421a tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:45.332138 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34120e20-e76b-49cd-a3a7-4deaecb5421a tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:45.332589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34120e20-e76b-49cd-a3a7-4deaecb5421a tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:45.333451 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34120e20-e76b-49cd-a3a7-4deaecb5421a tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:45.333900 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34120e20-e76b-49cd-a3a7-4deaecb5421a tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:45.362474 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-580f967e-ed79-4f4d-8de0-0658262745ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:45.363278 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-580f967e-ed79-4f4d-8de0-0658262745ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:45.369697 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-580f967e-ed79-4f4d-8de0-0658262745ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:45.370251 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-580f967e-ed79-4f4d-8de0-0658262745ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:45.371070 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-580f967e-ed79-4f4d-8de0-0658262745ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:45.371528 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-580f967e-ed79-4f4d-8de0-0658262745ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:45.514786 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-34120e20-e76b-49cd-a3a7-4deaecb5421a tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:45.522245 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-34120e20-e76b-49cd-a3a7-4deaecb5421a tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.200612 May 12 14:33:45.522940 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 134/254] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:45 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:45.544639 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-580f967e-ed79-4f4d-8de0-0658262745ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:45.556793 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-580f967e-ed79-4f4d-8de0-0658262745ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.199836 May 12 14:33:45.557392 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 121/255] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:45 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:45.598458 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a313d067-309d-4c6f-876b-a8164daebd87 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:45.599134 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a313d067-309d-4c6f-876b-a8164daebd87 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:45.606076 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a313d067-309d-4c6f-876b-a8164daebd87 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:45.606529 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a313d067-309d-4c6f-876b-a8164daebd87 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:45.607343 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a313d067-309d-4c6f-876b-a8164daebd87 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:45.607783 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a313d067-309d-4c6f-876b-a8164daebd87 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:45.747211 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a313d067-309d-4c6f-876b-a8164daebd87 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:45.754979 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a313d067-309d-4c6f-876b-a8164daebd87 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.160900 May 12 14:33:45.755905 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 135/256] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:45 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:46.541098 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-fe3b39bf-0568-4b47-8c57-fddb433c69e9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:46.541682 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-fe3b39bf-0568-4b47-8c57-fddb433c69e9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:46.549689 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fe3b39bf-0568-4b47-8c57-fddb433c69e9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:46.550144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fe3b39bf-0568-4b47-8c57-fddb433c69e9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:46.550934 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fe3b39bf-0568-4b47-8c57-fddb433c69e9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:46.551406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fe3b39bf-0568-4b47-8c57-fddb433c69e9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:46.574778 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f3e34f9d-5b4b-4f44-bcb5-d750ee5573a3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:46.575670 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f3e34f9d-5b4b-4f44-bcb5-d750ee5573a3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:46.581602 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f3e34f9d-5b4b-4f44-bcb5-d750ee5573a3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:46.582254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f3e34f9d-5b4b-4f44-bcb5-d750ee5573a3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:46.583074 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f3e34f9d-5b4b-4f44-bcb5-d750ee5573a3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:46.583526 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f3e34f9d-5b4b-4f44-bcb5-d750ee5573a3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:46.754389 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-fe3b39bf-0568-4b47-8c57-fddb433c69e9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:46.761278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f3e34f9d-5b4b-4f44-bcb5-d750ee5573a3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:46.764093 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-fe3b39bf-0568-4b47-8c57-fddb433c69e9 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.226876 May 12 14:33:46.764719 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 122/257] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:46 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:46.769917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f3e34f9d-5b4b-4f44-bcb5-d750ee5573a3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.198984 May 12 14:33:46.770514 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 136/258] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:46 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:46.772408 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8dcab57b-260f-4567-ab04-b9f15caae4f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:46.773037 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8dcab57b-260f-4567-ab04-b9f15caae4f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:46.779137 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8dcab57b-260f-4567-ab04-b9f15caae4f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:46.779603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8dcab57b-260f-4567-ab04-b9f15caae4f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:46.780391 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8dcab57b-260f-4567-ab04-b9f15caae4f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:46.780838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8dcab57b-260f-4567-ab04-b9f15caae4f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:46.928212 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8dcab57b-260f-4567-ab04-b9f15caae4f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:46.936872 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8dcab57b-260f-4567-ab04-b9f15caae4f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.168508 May 12 14:33:46.937483 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 123/259] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:46 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:47.783022 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f67314f4-27f1-48a3-aa3d-7e93f6c3e052 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:47.783711 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f67314f4-27f1-48a3-aa3d-7e93f6c3e052 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:47.787497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5d28628b-02ee-4c5c-aa92-19a57fba5f3a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:47.788126 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5d28628b-02ee-4c5c-aa92-19a57fba5f3a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:47.789805 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f67314f4-27f1-48a3-aa3d-7e93f6c3e052 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:47.790263 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f67314f4-27f1-48a3-aa3d-7e93f6c3e052 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:47.791147 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f67314f4-27f1-48a3-aa3d-7e93f6c3e052 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:47.791678 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f67314f4-27f1-48a3-aa3d-7e93f6c3e052 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:47.794556 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5d28628b-02ee-4c5c-aa92-19a57fba5f3a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:47.795070 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5d28628b-02ee-4c5c-aa92-19a57fba5f3a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:47.795858 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5d28628b-02ee-4c5c-aa92-19a57fba5f3a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:47.796329 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5d28628b-02ee-4c5c-aa92-19a57fba5f3a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:47.947724 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f67314f4-27f1-48a3-aa3d-7e93f6c3e052 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:47.960599 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f67314f4-27f1-48a3-aa3d-7e93f6c3e052 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.182024 May 12 14:33:47.971970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 137/260] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:47 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:47.976979 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-bc002503-c497-4799-8ad5-80c2a5be7d3a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:47.977594 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-bc002503-c497-4799-8ad5-80c2a5be7d3a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:47.984247 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bc002503-c497-4799-8ad5-80c2a5be7d3a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:47.984884 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bc002503-c497-4799-8ad5-80c2a5be7d3a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:47.985776 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bc002503-c497-4799-8ad5-80c2a5be7d3a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:47.986377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bc002503-c497-4799-8ad5-80c2a5be7d3a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:48.143127 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5d28628b-02ee-4c5c-aa92-19a57fba5f3a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:48.151290 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5d28628b-02ee-4c5c-aa92-19a57fba5f3a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.367425 May 12 14:33:48.151889 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 124/261] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:47 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:48.168967 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-37fa5008-8586-4164-8ea2-81da447b4ee1 req-5f87fd60-9645-4e7b-ad42-f0e82674f096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5ced7e-9d8b-4d24-a35d-876326b483ba", "name": "network-vif-plugged", "status": "completed", "tag": "62f6a176-00c7-4955-ac5a-e84fb95f6c3d"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:33:48.177028 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-37fa5008-8586-4164-8ea2-81da447b4ee1 req-5f87fd60-9645-4e7b-ad42-f0e82674f096 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:48.177509 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-37fa5008-8586-4164-8ea2-81da447b4ee1 req-5f87fd60-9645-4e7b-ad42-f0e82674f096 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:48.178808 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-bc002503-c497-4799-8ad5-80c2a5be7d3a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:48.186237 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-bc002503-c497-4799-8ad5-80c2a5be7d3a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.212972 May 12 14:33:48.186826 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 138/262] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:47 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:48.189060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-37fa5008-8586-4164-8ea2-81da447b4ee1 req-5f87fd60-9645-4e7b-ad42-f0e82674f096 service nova] Creating event network-vif-plugged:62f6a176-00c7-4955-ac5a-e84fb95f6c3d for instance 5c5ced7e-9d8b-4d24-a35d-876326b483ba on hv-cinder-77703 May 12 14:33:48.194369 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-37fa5008-8586-4164-8ea2-81da447b4ee1 req-5f87fd60-9645-4e7b-ad42-f0e82674f096 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028981 May 12 14:33:48.194970 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 125/263] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:33:48.977822 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c0ae625b-b4f6-4fbd-8898-652db4b29932 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:48.978443 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c0ae625b-b4f6-4fbd-8898-652db4b29932 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:48.984983 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c0ae625b-b4f6-4fbd-8898-652db4b29932 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:48.985952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c0ae625b-b4f6-4fbd-8898-652db4b29932 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:48.986742 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c0ae625b-b4f6-4fbd-8898-652db4b29932 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:48.987213 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c0ae625b-b4f6-4fbd-8898-652db4b29932 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:49.123568 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c0ae625b-b4f6-4fbd-8898-652db4b29932 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:49.131839 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c0ae625b-b4f6-4fbd-8898-652db4b29932 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.157889 May 12 14:33:49.132421 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 139/264] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:48 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:49.172929 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-297bd621-236f-4a19-9280-649d65fb3842 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:49.173627 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-297bd621-236f-4a19-9280-649d65fb3842 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:49.179955 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-297bd621-236f-4a19-9280-649d65fb3842 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:49.180410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-297bd621-236f-4a19-9280-649d65fb3842 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:49.181193 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-297bd621-236f-4a19-9280-649d65fb3842 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:49.181631 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-297bd621-236f-4a19-9280-649d65fb3842 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:49.202953 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f1f03c52-2c74-453e-bf16-fad1bac8697b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:49.203601 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f1f03c52-2c74-453e-bf16-fad1bac8697b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:49.210365 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1f03c52-2c74-453e-bf16-fad1bac8697b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:49.210815 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1f03c52-2c74-453e-bf16-fad1bac8697b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:49.211639 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1f03c52-2c74-453e-bf16-fad1bac8697b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:49.212079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1f03c52-2c74-453e-bf16-fad1bac8697b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:49.386272 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-297bd621-236f-4a19-9280-649d65fb3842 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:49.394227 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f1f03c52-2c74-453e-bf16-fad1bac8697b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:49.394452 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-297bd621-236f-4a19-9280-649d65fb3842 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.226240 May 12 14:33:49.395057 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 126/265] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:49 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:49.401511 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f1f03c52-2c74-453e-bf16-fad1bac8697b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.202460 May 12 14:33:49.402087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 140/266] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:49 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:50.150471 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5ea8163c-ade3-4d7b-b059-df3b9416c8e2 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:50.151266 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5ea8163c-ade3-4d7b-b059-df3b9416c8e2 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:50.165410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ea8163c-ade3-4d7b-b059-df3b9416c8e2 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:50.165953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ea8163c-ade3-4d7b-b059-df3b9416c8e2 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:50.166820 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ea8163c-ade3-4d7b-b059-df3b9416c8e2 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:50.167358 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ea8163c-ade3-4d7b-b059-df3b9416c8e2 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:50.358343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5ea8163c-ade3-4d7b-b059-df3b9416c8e2 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:50.366410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5ea8163c-ade3-4d7b-b059-df3b9416c8e2 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.221569 May 12 14:33:50.366998 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 127/267] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:50 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:50.417727 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6c79fe75-3e3d-4ea9-92d6-086bb7376ace tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:50.418322 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-37bd91aa-cdbb-44a5-bbd8-44c05c7ed598 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:50.418443 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6c79fe75-3e3d-4ea9-92d6-086bb7376ace tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:50.418545 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-37bd91aa-cdbb-44a5-bbd8-44c05c7ed598 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:50.424959 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c79fe75-3e3d-4ea9-92d6-086bb7376ace tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:50.425170 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-37bd91aa-cdbb-44a5-bbd8-44c05c7ed598 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:50.425464 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c79fe75-3e3d-4ea9-92d6-086bb7376ace tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:50.425623 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-37bd91aa-cdbb-44a5-bbd8-44c05c7ed598 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:50.426253 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c79fe75-3e3d-4ea9-92d6-086bb7376ace tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:50.426569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-37bd91aa-cdbb-44a5-bbd8-44c05c7ed598 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:50.426681 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c79fe75-3e3d-4ea9-92d6-086bb7376ace tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:50.427019 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-37bd91aa-cdbb-44a5-bbd8-44c05c7ed598 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:50.632525 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-37bd91aa-cdbb-44a5-bbd8-44c05c7ed598 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:50.639896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-37bd91aa-cdbb-44a5-bbd8-44c05c7ed598 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.225982 May 12 14:33:50.640580 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 128/268] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:50 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:50.643912 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6c79fe75-3e3d-4ea9-92d6-086bb7376ace tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:50.651566 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6c79fe75-3e3d-4ea9-92d6-086bb7376ace tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.237660 May 12 14:33:50.652155 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 141/269] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:50 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:51.383549 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-86092104-f3e8-4df8-9a89-9d56dbb82597 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:51.384177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-86092104-f3e8-4df8-9a89-9d56dbb82597 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:51.390706 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-86092104-f3e8-4df8-9a89-9d56dbb82597 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:51.391206 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-86092104-f3e8-4df8-9a89-9d56dbb82597 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:51.392644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-86092104-f3e8-4df8-9a89-9d56dbb82597 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:51.393095 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-86092104-f3e8-4df8-9a89-9d56dbb82597 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:51.525962 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-86092104-f3e8-4df8-9a89-9d56dbb82597 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:51.538008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-86092104-f3e8-4df8-9a89-9d56dbb82597 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.157971 May 12 14:33:51.542231 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 129/270] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:51 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:51.657504 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e1c39b2a-5452-45c7-8a97-464e1e1bd673 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:51.658883 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e1c39b2a-5452-45c7-8a97-464e1e1bd673 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:51.665308 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1c39b2a-5452-45c7-8a97-464e1e1bd673 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:51.665766 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1c39b2a-5452-45c7-8a97-464e1e1bd673 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:51.666556 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1c39b2a-5452-45c7-8a97-464e1e1bd673 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:51.666999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1c39b2a-5452-45c7-8a97-464e1e1bd673 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:51.668335 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8bc43869-b857-47e1-9c4a-76efda1f38a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:51.668956 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8bc43869-b857-47e1-9c4a-76efda1f38a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:51.674962 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8bc43869-b857-47e1-9c4a-76efda1f38a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:51.675696 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8bc43869-b857-47e1-9c4a-76efda1f38a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:51.676497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8bc43869-b857-47e1-9c4a-76efda1f38a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:51.676943 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8bc43869-b857-47e1-9c4a-76efda1f38a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:51.944235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e1c39b2a-5452-45c7-8a97-464e1e1bd673 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:51.952402 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e1c39b2a-5452-45c7-8a97-464e1e1bd673 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.299190 May 12 14:33:51.953351 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 142/271] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:51 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:51.974782 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8bc43869-b857-47e1-9c4a-76efda1f38a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:51.982393 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8bc43869-b857-47e1-9c4a-76efda1f38a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.317803 May 12 14:33:51.983155 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 130/272] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:51 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:52.562351 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-68f0d059-68fe-4314-96de-d7ca412be679 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:52.562881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-68f0d059-68fe-4314-96de-d7ca412be679 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:52.569036 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-68f0d059-68fe-4314-96de-d7ca412be679 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:52.569483 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-68f0d059-68fe-4314-96de-d7ca412be679 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:52.570267 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-68f0d059-68fe-4314-96de-d7ca412be679 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:52.570702 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-68f0d059-68fe-4314-96de-d7ca412be679 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:52.706809 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-68f0d059-68fe-4314-96de-d7ca412be679 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:52.717674 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-68f0d059-68fe-4314-96de-d7ca412be679 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.159193 May 12 14:33:52.718276 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 143/273] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:52 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:52.908888 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-15a577b3-0ec9-48cb-8b97-01c369e0e43b req-ee0dd0ec-7c72-43f1-a5ab-07fe8fb65d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8855245c-3865-4c1b-8dd4-da43c780113e", "name": "network-vif-plugged", "status": "completed", "tag": "f636a2b1-87e8-46f9-b1ec-23fa693c4a57"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:33:52.920239 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-15a577b3-0ec9-48cb-8b97-01c369e0e43b req-ee0dd0ec-7c72-43f1-a5ab-07fe8fb65d85 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:52.920670 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-15a577b3-0ec9-48cb-8b97-01c369e0e43b req-ee0dd0ec-7c72-43f1-a5ab-07fe8fb65d85 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:52.933558 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-15a577b3-0ec9-48cb-8b97-01c369e0e43b req-ee0dd0ec-7c72-43f1-a5ab-07fe8fb65d85 service nova] Creating event network-vif-plugged:f636a2b1-87e8-46f9-b1ec-23fa693c4a57 for instance 8855245c-3865-4c1b-8dd4-da43c780113e on hv-cinder-77703 May 12 14:33:52.945188 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-15a577b3-0ec9-48cb-8b97-01c369e0e43b req-ee0dd0ec-7c72-43f1-a5ab-07fe8fb65d85 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035501 May 12 14:33:52.945188 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 131/274] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:33:52.973509 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e9ebcece-fed0-47cf-90f1-378a89b39034 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:52.974777 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e9ebcece-fed0-47cf-90f1-378a89b39034 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:52.992870 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e9ebcece-fed0-47cf-90f1-378a89b39034 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:52.993855 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e9ebcece-fed0-47cf-90f1-378a89b39034 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:52.995466 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e9ebcece-fed0-47cf-90f1-378a89b39034 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:52.996154 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e9ebcece-fed0-47cf-90f1-378a89b39034 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:53.000232 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b2ed6728-3528-46bf-a65a-065537022367 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:53.001585 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b2ed6728-3528-46bf-a65a-065537022367 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:53.008258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b2ed6728-3528-46bf-a65a-065537022367 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:53.008655 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b2ed6728-3528-46bf-a65a-065537022367 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:53.009449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b2ed6728-3528-46bf-a65a-065537022367 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:53.009898 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b2ed6728-3528-46bf-a65a-065537022367 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:53.372379 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b2ed6728-3528-46bf-a65a-065537022367 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:53.382454 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b2ed6728-3528-46bf-a65a-065537022367 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.386636 May 12 14:33:53.383223 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 132/275] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:52 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:53.581361 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e9ebcece-fed0-47cf-90f1-378a89b39034 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:53.583154 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e9ebcece-fed0-47cf-90f1-378a89b39034 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.617714 May 12 14:33:53.583763 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 144/276] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:52 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:53.743817 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5a7f632f-768a-4c93-a88f-1bc109ad786c tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:53.744431 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5a7f632f-768a-4c93-a88f-1bc109ad786c tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:53.750409 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5a7f632f-768a-4c93-a88f-1bc109ad786c tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:53.750932 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5a7f632f-768a-4c93-a88f-1bc109ad786c tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:53.751749 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5a7f632f-768a-4c93-a88f-1bc109ad786c tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:53.752182 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5a7f632f-768a-4c93-a88f-1bc109ad786c tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:53.887059 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5a7f632f-768a-4c93-a88f-1bc109ad786c tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:53.895196 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5a7f632f-768a-4c93-a88f-1bc109ad786c tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.155233 May 12 14:33:53.895772 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 133/277] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:53 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:54.399697 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-112a3d09-93d3-4e43-a016-7e8839c827a8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:54.400315 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-112a3d09-93d3-4e43-a016-7e8839c827a8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:54.406354 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-112a3d09-93d3-4e43-a016-7e8839c827a8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:54.406808 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-112a3d09-93d3-4e43-a016-7e8839c827a8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:54.407647 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-112a3d09-93d3-4e43-a016-7e8839c827a8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:54.408082 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-112a3d09-93d3-4e43-a016-7e8839c827a8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:54.537873 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-112a3d09-93d3-4e43-a016-7e8839c827a8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:54.545273 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-112a3d09-93d3-4e43-a016-7e8839c827a8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.149513 May 12 14:33:54.545851 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 145/278] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:54 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:54.604101 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1eb0f4c8-fa62-4c30-8cf7-1b20b26ffbb3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:54.604848 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1eb0f4c8-fa62-4c30-8cf7-1b20b26ffbb3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:54.613218 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1eb0f4c8-fa62-4c30-8cf7-1b20b26ffbb3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:54.613692 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1eb0f4c8-fa62-4c30-8cf7-1b20b26ffbb3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:54.614552 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1eb0f4c8-fa62-4c30-8cf7-1b20b26ffbb3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:54.615128 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1eb0f4c8-fa62-4c30-8cf7-1b20b26ffbb3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:54.756230 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1eb0f4c8-fa62-4c30-8cf7-1b20b26ffbb3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:54.763678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1eb0f4c8-fa62-4c30-8cf7-1b20b26ffbb3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.166922 May 12 14:33:54.764280 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 134/279] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:54 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:54.913079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-826b2df6-49d6-41f0-8841-e422bcdc2726 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:54.913693 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-826b2df6-49d6-41f0-8841-e422bcdc2726 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:54.919764 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-826b2df6-49d6-41f0-8841-e422bcdc2726 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:54.920216 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-826b2df6-49d6-41f0-8841-e422bcdc2726 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:54.920995 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-826b2df6-49d6-41f0-8841-e422bcdc2726 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:54.921434 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-826b2df6-49d6-41f0-8841-e422bcdc2726 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:55.054325 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-826b2df6-49d6-41f0-8841-e422bcdc2726 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:55.061934 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-826b2df6-49d6-41f0-8841-e422bcdc2726 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.152952 May 12 14:33:55.062514 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 146/280] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:54 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:55.561847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-824bcfd9-845a-41fd-92ca-fca391fd3e81 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:55.562498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-824bcfd9-845a-41fd-92ca-fca391fd3e81 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:55.568570 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-824bcfd9-845a-41fd-92ca-fca391fd3e81 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:55.569023 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-824bcfd9-845a-41fd-92ca-fca391fd3e81 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:55.569802 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-824bcfd9-845a-41fd-92ca-fca391fd3e81 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:55.570242 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-824bcfd9-845a-41fd-92ca-fca391fd3e81 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:55.711721 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-824bcfd9-845a-41fd-92ca-fca391fd3e81 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:55.719306 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-824bcfd9-845a-41fd-92ca-fca391fd3e81 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.161257 May 12 14:33:55.720510 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 135/281] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:55 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:55.781423 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c2562e4d-78f4-43ea-8469-c4c5ae9e7c37 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:55.782680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c2562e4d-78f4-43ea-8469-c4c5ae9e7c37 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:55.791706 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c2562e4d-78f4-43ea-8469-c4c5ae9e7c37 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:55.792595 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c2562e4d-78f4-43ea-8469-c4c5ae9e7c37 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:55.793724 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c2562e4d-78f4-43ea-8469-c4c5ae9e7c37 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:55.794240 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c2562e4d-78f4-43ea-8469-c4c5ae9e7c37 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:55.943336 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c2562e4d-78f4-43ea-8469-c4c5ae9e7c37 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:55.952860 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c2562e4d-78f4-43ea-8469-c4c5ae9e7c37 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.175148 May 12 14:33:55.954387 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 147/282] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:55 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:56.080430 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2d8ad79d-edc8-4a33-80f2-820acbb357db tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:56.081071 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2d8ad79d-edc8-4a33-80f2-820acbb357db tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:56.087607 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2d8ad79d-edc8-4a33-80f2-820acbb357db tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:56.088104 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2d8ad79d-edc8-4a33-80f2-820acbb357db tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:56.088879 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2d8ad79d-edc8-4a33-80f2-820acbb357db tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:56.089328 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2d8ad79d-edc8-4a33-80f2-820acbb357db tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:56.228356 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2d8ad79d-edc8-4a33-80f2-820acbb357db tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:56.236498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2d8ad79d-edc8-4a33-80f2-820acbb357db tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.161211 May 12 14:33:56.237119 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 136/283] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:56 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:56.737699 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f7e0c200-bf7a-4246-a3ae-1d017e3faec0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:56.738313 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f7e0c200-bf7a-4246-a3ae-1d017e3faec0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:56.744498 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f7e0c200-bf7a-4246-a3ae-1d017e3faec0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:56.744952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f7e0c200-bf7a-4246-a3ae-1d017e3faec0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:56.745744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f7e0c200-bf7a-4246-a3ae-1d017e3faec0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:56.746187 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f7e0c200-bf7a-4246-a3ae-1d017e3faec0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:56.891988 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f7e0c200-bf7a-4246-a3ae-1d017e3faec0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:56.899761 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f7e0c200-bf7a-4246-a3ae-1d017e3faec0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.166845 May 12 14:33:56.900348 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 148/284] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:56 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:56.973311 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-782bc311-5eac-450e-90c6-088367b02ce1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:56.973935 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-782bc311-5eac-450e-90c6-088367b02ce1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:56.980474 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-782bc311-5eac-450e-90c6-088367b02ce1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:56.980935 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-782bc311-5eac-450e-90c6-088367b02ce1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:56.981721 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-782bc311-5eac-450e-90c6-088367b02ce1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:56.982205 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-782bc311-5eac-450e-90c6-088367b02ce1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:57.115109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-782bc311-5eac-450e-90c6-088367b02ce1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:57.122526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-782bc311-5eac-450e-90c6-088367b02ce1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.153725 May 12 14:33:57.123129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 137/285] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:56 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:57.253829 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4aafcd33-991b-4b33-a36b-9b4591802b73 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:57.254439 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4aafcd33-991b-4b33-a36b-9b4591802b73 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:57.260827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4aafcd33-991b-4b33-a36b-9b4591802b73 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:57.261291 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4aafcd33-991b-4b33-a36b-9b4591802b73 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:57.262291 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4aafcd33-991b-4b33-a36b-9b4591802b73 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:57.262842 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4aafcd33-991b-4b33-a36b-9b4591802b73 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:57.414582 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4aafcd33-991b-4b33-a36b-9b4591802b73 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:57.422023 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4aafcd33-991b-4b33-a36b-9b4591802b73 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.172266 May 12 14:33:57.423634 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 149/286] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:57 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:57.921259 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-721b9a35-bd4a-400f-95fe-c9ff9e30c8d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:57.923759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-721b9a35-bd4a-400f-95fe-c9ff9e30c8d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:57.933067 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-721b9a35-bd4a-400f-95fe-c9ff9e30c8d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:57.943544 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-721b9a35-bd4a-400f-95fe-c9ff9e30c8d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:57.944610 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-721b9a35-bd4a-400f-95fe-c9ff9e30c8d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:57.945066 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-721b9a35-bd4a-400f-95fe-c9ff9e30c8d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:58.089132 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-721b9a35-bd4a-400f-95fe-c9ff9e30c8d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:58.097430 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-721b9a35-bd4a-400f-95fe-c9ff9e30c8d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.184313 May 12 14:33:58.098376 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 138/287] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:57 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:58.139812 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d90ebde0-39cf-4ede-9c3d-c93aa76ed52a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:58.140536 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d90ebde0-39cf-4ede-9c3d-c93aa76ed52a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:58.150279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d90ebde0-39cf-4ede-9c3d-c93aa76ed52a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:58.150808 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d90ebde0-39cf-4ede-9c3d-c93aa76ed52a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:58.151697 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d90ebde0-39cf-4ede-9c3d-c93aa76ed52a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:58.152208 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d90ebde0-39cf-4ede-9c3d-c93aa76ed52a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:58.295928 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d90ebde0-39cf-4ede-9c3d-c93aa76ed52a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:58.304552 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d90ebde0-39cf-4ede-9c3d-c93aa76ed52a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.168911 May 12 14:33:58.305146 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 150/288] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:58 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:58.445166 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8eb8349a-aaf9-442b-9e46-3d54b4248ca0 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:58.445855 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8eb8349a-aaf9-442b-9e46-3d54b4248ca0 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:58.452798 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8eb8349a-aaf9-442b-9e46-3d54b4248ca0 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:58.453318 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8eb8349a-aaf9-442b-9e46-3d54b4248ca0 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:58.454690 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8eb8349a-aaf9-442b-9e46-3d54b4248ca0 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:58.455161 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8eb8349a-aaf9-442b-9e46-3d54b4248ca0 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:58.617629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8eb8349a-aaf9-442b-9e46-3d54b4248ca0 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:58.625640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8eb8349a-aaf9-442b-9e46-3d54b4248ca0 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.184407 May 12 14:33:58.626262 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 139/289] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:58 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:59.115834 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f16ab848-95e6-476c-8b31-a7a363b385b0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:59.117076 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f16ab848-95e6-476c-8b31-a7a363b385b0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:59.126526 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f16ab848-95e6-476c-8b31-a7a363b385b0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:59.127265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f16ab848-95e6-476c-8b31-a7a363b385b0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:59.128230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f16ab848-95e6-476c-8b31-a7a363b385b0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:59.129119 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f16ab848-95e6-476c-8b31-a7a363b385b0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:59.191359 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1330061953", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-349363195", "security_groups": [{"name": "tempest-secgroup-smoke-2090511352"}], "block_device_mapping_v2": [{"uuid": "2e0e2235-be71-482f-a048-e519de8c66ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5b96f110-6030-45d9-96d1-0bc86d38fd01"}]}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:33:59.288590 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f16ab848-95e6-476c-8b31-a7a363b385b0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:59.299409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f16ab848-95e6-476c-8b31-a7a363b385b0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.189254 May 12 14:33:59.299994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 151/290] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:59 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:33:59.317915 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.network.neutron [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] validate_networks() for [('5b96f110-6030-45d9-96d1-0bc86d38fd01', None, None, None, None, None)] {{(pid=118217) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:33:59.321823 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0ffb4b7f-953b-46b1-9635-b671400ded88 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:59.322441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0ffb4b7f-953b-46b1-9635-b671400ded88 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:59.332135 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0ffb4b7f-953b-46b1-9635-b671400ded88 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:59.332873 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0ffb4b7f-953b-46b1-9635-b671400ded88 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:59.334205 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0ffb4b7f-953b-46b1-9635-b671400ded88 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:59.334905 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0ffb4b7f-953b-46b1-9635-b671400ded88 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:59.565442 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0ffb4b7f-953b-46b1-9635-b671400ded88 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:59.573001 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0ffb4b7f-953b-46b1-9635-b671400ded88 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.254924 May 12 14:33:59.573816 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 152/291] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:59 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:59.643180 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-66e01114-c300-42f6-9b5e-dbc54db8b573 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:33:59.643802 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-66e01114-c300-42f6-9b5e-dbc54db8b573 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:33:59.650099 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-66e01114-c300-42f6-9b5e-dbc54db8b573 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:59.650560 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-66e01114-c300-42f6-9b5e-dbc54db8b573 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:59.651425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-66e01114-c300-42f6-9b5e-dbc54db8b573 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:59.659094 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-66e01114-c300-42f6-9b5e-dbc54db8b573 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:59.836324 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Flavor limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:33:59.836767 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Image limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:33:59.837277 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Flavor pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:33:59.838019 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Image pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:33:59.838449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:33:59.851460 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:59.851460 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:59.851460 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:33:59.851460 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:33:59.858719 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-66e01114-c300-42f6-9b5e-dbc54db8b573 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:33:59.871266 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Getting quotas for project 0ba0ea753bb0496cbf274e802f50dd0e. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:33:59.874086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-66e01114-c300-42f6-9b5e-dbc54db8b573 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.234445 May 12 14:33:59.875450 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 153/292] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:33:59 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:33:59.881330 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Getting quotas for user a64c3ea69151401897e4203095676543 and project 0ba0ea753bb0496cbf274e802f50dd0e. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:33:59.944021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Going to run 1 instances... {{(pid=118217) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:33:59.946145 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e0e2235-be71-482f-a048-e519de8c66ff',volume_size=None,volume_type=None)] {{(pid=118217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:34:00.083164 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9ed99acf-5ac9-4667-ab5b-ba77391b55f3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.896356 May 12 14:34:00.083999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 140/293] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:33:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 14:34:00.095670 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-eaca5baf-72ad-41f8-9e7b-e361d449fb98 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:00.096135 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-eaca5baf-72ad-41f8-9e7b-e361d449fb98 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:00.153350 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-eaca5baf-72ad-41f8-9e7b-e361d449fb98 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:00.163660 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-eaca5baf-72ad-41f8-9e7b-e361d449fb98 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1094 microversion: 2.1 time: 0.072422 May 12 14:34:00.164859 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 154/294] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:00 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:00.316478 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-cbe85aa9-6194-4190-90e9-2fdd0c5963d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:00.317188 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-cbe85aa9-6194-4190-90e9-2fdd0c5963d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:00.325185 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cbe85aa9-6194-4190-90e9-2fdd0c5963d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:00.325654 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cbe85aa9-6194-4190-90e9-2fdd0c5963d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:00.326580 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cbe85aa9-6194-4190-90e9-2fdd0c5963d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:00.327143 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cbe85aa9-6194-4190-90e9-2fdd0c5963d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:00.484590 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-cbe85aa9-6194-4190-90e9-2fdd0c5963d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:00.491563 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-cbe85aa9-6194-4190-90e9-2fdd0c5963d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.179378 May 12 14:34:00.492159 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 141/295] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:00 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:00.590496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-738bf46b-b309-494c-ac25-9e7fc7f01bff tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:00.591248 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-738bf46b-b309-494c-ac25-9e7fc7f01bff tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:00.597196 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-738bf46b-b309-494c-ac25-9e7fc7f01bff tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:00.597653 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-738bf46b-b309-494c-ac25-9e7fc7f01bff tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:00.598514 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-738bf46b-b309-494c-ac25-9e7fc7f01bff tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:00.598962 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-738bf46b-b309-494c-ac25-9e7fc7f01bff tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:00.765660 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-738bf46b-b309-494c-ac25-9e7fc7f01bff tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:00.773887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-738bf46b-b309-494c-ac25-9e7fc7f01bff tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.187860 May 12 14:34:00.774467 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 155/296] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:00 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:00.895823 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4fc84ac1-4bf5-4c4a-8505-f4e9e8a0a4de tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:00.896436 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4fc84ac1-4bf5-4c4a-8505-f4e9e8a0a4de tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:00.902505 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4fc84ac1-4bf5-4c4a-8505-f4e9e8a0a4de tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:00.902994 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4fc84ac1-4bf5-4c4a-8505-f4e9e8a0a4de tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:00.903813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4fc84ac1-4bf5-4c4a-8505-f4e9e8a0a4de tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:00.904254 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4fc84ac1-4bf5-4c4a-8505-f4e9e8a0a4de tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:01.038688 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4fc84ac1-4bf5-4c4a-8505-f4e9e8a0a4de tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:01.046111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4fc84ac1-4bf5-4c4a-8505-f4e9e8a0a4de tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.154126 May 12 14:34:01.046720 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 142/297] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:00 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:01.184252 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-248aaf3b-02b4-4417-a5b5-f496575fe67c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:01.184784 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-248aaf3b-02b4-4417-a5b5-f496575fe67c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:01.191000 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-248aaf3b-02b4-4417-a5b5-f496575fe67c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:01.191484 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-248aaf3b-02b4-4417-a5b5-f496575fe67c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:01.192269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-248aaf3b-02b4-4417-a5b5-f496575fe67c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:01.192710 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-248aaf3b-02b4-4417-a5b5-f496575fe67c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:01.254360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-248aaf3b-02b4-4417-a5b5-f496575fe67c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:01.261787 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-248aaf3b-02b4-4417-a5b5-f496575fe67c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1144 microversion: 2.1 time: 0.081288 May 12 14:34:01.262375 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 156/298] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:01 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:01.509909 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-59748094-b866-40b6-ae75-b37744dd041b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:01.510505 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-59748094-b866-40b6-ae75-b37744dd041b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:01.517380 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-59748094-b866-40b6-ae75-b37744dd041b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:01.517880 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-59748094-b866-40b6-ae75-b37744dd041b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:01.518688 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-59748094-b866-40b6-ae75-b37744dd041b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:01.519177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-59748094-b866-40b6-ae75-b37744dd041b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:01.537323 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-15dcc2db-0790-4f84-b27b-4c3a21630c25 req-3898f8a7-a917-4828-8189-18c4d4be981b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0d59a6-8822-4d8d-83c9-390537c9818a", "name": "network-vif-plugged", "status": "completed", "tag": "03346ca6-97d2-422d-8314-1e57b404e30b"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:01.546562 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-15dcc2db-0790-4f84-b27b-4c3a21630c25 req-3898f8a7-a917-4828-8189-18c4d4be981b service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:01.547534 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-15dcc2db-0790-4f84-b27b-4c3a21630c25 req-3898f8a7-a917-4828-8189-18c4d4be981b service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:01.560068 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-15dcc2db-0790-4f84-b27b-4c3a21630c25 req-3898f8a7-a917-4828-8189-18c4d4be981b service nova] Creating event network-vif-plugged:03346ca6-97d2-422d-8314-1e57b404e30b for instance 7f0d59a6-8822-4d8d-83c9-390537c9818a on hv-cinder-77703 May 12 14:34:01.565301 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-15dcc2db-0790-4f84-b27b-4c3a21630c25 req-3898f8a7-a917-4828-8189-18c4d4be981b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031883 May 12 14:34:01.566082 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 157/299] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:34:01.660114 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-59748094-b866-40b6-ae75-b37744dd041b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:01.667530 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-59748094-b866-40b6-ae75-b37744dd041b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.161917 May 12 14:34:01.668134 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 143/300] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:01 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:01.791357 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e1554e07-eeb0-4dbc-a6b9-2800517aa4ca tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:01.792165 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e1554e07-eeb0-4dbc-a6b9-2800517aa4ca tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:01.801199 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1554e07-eeb0-4dbc-a6b9-2800517aa4ca tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:01.801199 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1554e07-eeb0-4dbc-a6b9-2800517aa4ca tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:01.801199 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1554e07-eeb0-4dbc-a6b9-2800517aa4ca tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:01.801199 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1554e07-eeb0-4dbc-a6b9-2800517aa4ca tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:01.945857 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e1554e07-eeb0-4dbc-a6b9-2800517aa4ca tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:01.954167 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e1554e07-eeb0-4dbc-a6b9-2800517aa4ca tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.166492 May 12 14:34:01.954777 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 158/301] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:01 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:02.065084 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-94ed80d9-fbc6-4397-840f-4d091eeef577 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:02.065656 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-94ed80d9-fbc6-4397-840f-4d091eeef577 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:02.072087 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-94ed80d9-fbc6-4397-840f-4d091eeef577 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:02.072600 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-94ed80d9-fbc6-4397-840f-4d091eeef577 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:02.073598 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-94ed80d9-fbc6-4397-840f-4d091eeef577 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:02.074073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-94ed80d9-fbc6-4397-840f-4d091eeef577 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:02.209587 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-94ed80d9-fbc6-4397-840f-4d091eeef577 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:02.217123 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-94ed80d9-fbc6-4397-840f-4d091eeef577 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1313 microversion: 2.1 time: 0.157177 May 12 14:34:02.217713 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 144/302] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:02 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:02.277811 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-acae8369-42eb-442e-8c9e-ea310462fb69 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:02.278431 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-acae8369-42eb-442e-8c9e-ea310462fb69 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:02.284413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-acae8369-42eb-442e-8c9e-ea310462fb69 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:02.284864 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-acae8369-42eb-442e-8c9e-ea310462fb69 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:02.285639 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-acae8369-42eb-442e-8c9e-ea310462fb69 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:02.286072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-acae8369-42eb-442e-8c9e-ea310462fb69 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:02.356352 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-acae8369-42eb-442e-8c9e-ea310462fb69 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:02.366125 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-acae8369-42eb-442e-8c9e-ea310462fb69 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1144 microversion: 2.1 time: 0.092142 May 12 14:34:02.374076 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 159/303] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:02 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:02.690472 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-49d55bc5-4456-46dd-8e8a-9e47cba97945 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:02.691020 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-49d55bc5-4456-46dd-8e8a-9e47cba97945 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:02.697719 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-49d55bc5-4456-46dd-8e8a-9e47cba97945 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:02.698175 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-49d55bc5-4456-46dd-8e8a-9e47cba97945 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:02.698983 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-49d55bc5-4456-46dd-8e8a-9e47cba97945 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:02.699457 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-49d55bc5-4456-46dd-8e8a-9e47cba97945 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:02.832870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-49d55bc5-4456-46dd-8e8a-9e47cba97945 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:02.840652 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-49d55bc5-4456-46dd-8e8a-9e47cba97945 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.154434 May 12 14:34:02.841220 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 145/304] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:02 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:02.971761 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f16fcefb-ae99-4482-959e-b85bec32e991 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:02.972409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f16fcefb-ae99-4482-959e-b85bec32e991 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:02.978478 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f16fcefb-ae99-4482-959e-b85bec32e991 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:02.978911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f16fcefb-ae99-4482-959e-b85bec32e991 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:02.980001 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f16fcefb-ae99-4482-959e-b85bec32e991 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:02.980142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f16fcefb-ae99-4482-959e-b85bec32e991 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:03.147607 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f16fcefb-ae99-4482-959e-b85bec32e991 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:03.162110 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f16fcefb-ae99-4482-959e-b85bec32e991 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.194425 May 12 14:34:03.163098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 160/305] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:02 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:03.234134 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-56dd8171-0197-466a-a61b-d1d83ca58cb6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:03.235193 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-56dd8171-0197-466a-a61b-d1d83ca58cb6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:03.243423 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-56dd8171-0197-466a-a61b-d1d83ca58cb6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:03.244106 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-56dd8171-0197-466a-a61b-d1d83ca58cb6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:03.245313 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-56dd8171-0197-466a-a61b-d1d83ca58cb6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:03.245973 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-56dd8171-0197-466a-a61b-d1d83ca58cb6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:03.383871 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9328bfcc-96c1-490f-81b3-ab62e2a42c03 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:03.384501 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9328bfcc-96c1-490f-81b3-ab62e2a42c03 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:03.390409 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-56dd8171-0197-466a-a61b-d1d83ca58cb6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:03.391632 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9328bfcc-96c1-490f-81b3-ab62e2a42c03 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:03.392342 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9328bfcc-96c1-490f-81b3-ab62e2a42c03 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:03.393424 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9328bfcc-96c1-490f-81b3-ab62e2a42c03 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:03.394514 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9328bfcc-96c1-490f-81b3-ab62e2a42c03 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:03.399831 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-56dd8171-0197-466a-a61b-d1d83ca58cb6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1462 microversion: 2.1 time: 0.169317 May 12 14:34:03.403672 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 146/306] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:03 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1462 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:03.451306 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c45c28b7-c6eb-41a1-a8da-f783d54b96ee tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:03.451809 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c45c28b7-c6eb-41a1-a8da-f783d54b96ee tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:03.458389 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c45c28b7-c6eb-41a1-a8da-f783d54b96ee tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:03.458848 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c45c28b7-c6eb-41a1-a8da-f783d54b96ee tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:03.459655 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c45c28b7-c6eb-41a1-a8da-f783d54b96ee tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:03.460096 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c45c28b7-c6eb-41a1-a8da-f783d54b96ee tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:03.494791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c45c28b7-c6eb-41a1-a8da-f783d54b96ee tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Going to try to terminate instance {{(pid=118217) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:34:03.496551 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9328bfcc-96c1-490f-81b3-ab62e2a42c03 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:03.506740 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9328bfcc-96c1-490f-81b3-ab62e2a42c03 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1192 microversion: 2.1 time: 0.126239 May 12 14:34:03.516679 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 161/307] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:03 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1192 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:03.596782 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c45c28b7-c6eb-41a1-a8da-f783d54b96ee tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 204 len: 0 microversion: 2.1 time: 0.149529 May 12 14:34:03.597378 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 147/308] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:34:03 2022] DELETE /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 14:34:03.605837 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0de40fcb-7151-4c3b-a738-e3f894329690 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:03.606474 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0de40fcb-7151-4c3b-a738-e3f894329690 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:03.612644 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0de40fcb-7151-4c3b-a738-e3f894329690 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:03.613089 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0de40fcb-7151-4c3b-a738-e3f894329690 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:03.613858 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0de40fcb-7151-4c3b-a738-e3f894329690 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:03.614288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0de40fcb-7151-4c3b-a738-e3f894329690 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:03.746763 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0de40fcb-7151-4c3b-a738-e3f894329690 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:03.755697 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0de40fcb-7151-4c3b-a738-e3f894329690 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1468 microversion: 2.1 time: 0.153751 May 12 14:34:03.756284 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 162/309] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:03 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1468 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:03.858274 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3e0ad8af-4c1a-45ab-a424-4a62094134dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:03.858971 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3e0ad8af-4c1a-45ab-a424-4a62094134dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:03.866572 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e0ad8af-4c1a-45ab-a424-4a62094134dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:03.867018 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e0ad8af-4c1a-45ab-a424-4a62094134dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:03.867821 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e0ad8af-4c1a-45ab-a424-4a62094134dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:03.868256 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e0ad8af-4c1a-45ab-a424-4a62094134dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:03.997656 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3e0ad8af-4c1a-45ab-a424-4a62094134dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:04.006017 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3e0ad8af-4c1a-45ab-a424-4a62094134dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.151880 May 12 14:34:04.006593 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 148/310] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:03 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:04.190313 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a62e4a65-ee74-4cd0-886e-e9afc237c34c tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:04.191305 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a62e4a65-ee74-4cd0-886e-e9afc237c34c tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:04.197615 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a62e4a65-ee74-4cd0-886e-e9afc237c34c tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:04.198070 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a62e4a65-ee74-4cd0-886e-e9afc237c34c tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:04.198890 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a62e4a65-ee74-4cd0-886e-e9afc237c34c tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:04.199367 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a62e4a65-ee74-4cd0-886e-e9afc237c34c tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:04.351142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a62e4a65-ee74-4cd0-886e-e9afc237c34c tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:04.359060 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a62e4a65-ee74-4cd0-886e-e9afc237c34c tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.173858 May 12 14:34:04.360623 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 163/311] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:04 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:04.524559 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a2a3988a-8851-41d5-b0e1-a51600d17069 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:04.525096 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a2a3988a-8851-41d5-b0e1-a51600d17069 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:04.530958 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a2a3988a-8851-41d5-b0e1-a51600d17069 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:04.531445 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a2a3988a-8851-41d5-b0e1-a51600d17069 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:04.532903 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a2a3988a-8851-41d5-b0e1-a51600d17069 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:04.533347 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a2a3988a-8851-41d5-b0e1-a51600d17069 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:04.595794 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a2a3988a-8851-41d5-b0e1-a51600d17069 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:04.603082 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a2a3988a-8851-41d5-b0e1-a51600d17069 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1210 microversion: 2.1 time: 0.082505 May 12 14:34:04.603658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 149/312] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:04 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:04.773074 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-36da0269-f1c2-4255-b4d7-0a82a4b56fbd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:04.773692 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-36da0269-f1c2-4255-b4d7-0a82a4b56fbd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:04.779723 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-36da0269-f1c2-4255-b4d7-0a82a4b56fbd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:04.780121 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-36da0269-f1c2-4255-b4d7-0a82a4b56fbd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:04.780892 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-36da0269-f1c2-4255-b4d7-0a82a4b56fbd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:04.781334 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-36da0269-f1c2-4255-b4d7-0a82a4b56fbd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:04.906618 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-36da0269-f1c2-4255-b4d7-0a82a4b56fbd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:04.914053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-36da0269-f1c2-4255-b4d7-0a82a4b56fbd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1468 microversion: 2.1 time: 0.144861 May 12 14:34:04.914611 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 164/313] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:04 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1468 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:05.023115 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1d3e2b36-55f1-40d6-8282-80526999b23a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:05.023753 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1d3e2b36-55f1-40d6-8282-80526999b23a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:05.030148 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d3e2b36-55f1-40d6-8282-80526999b23a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:05.030537 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d3e2b36-55f1-40d6-8282-80526999b23a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:05.031335 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d3e2b36-55f1-40d6-8282-80526999b23a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:05.031796 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d3e2b36-55f1-40d6-8282-80526999b23a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:05.157138 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1d3e2b36-55f1-40d6-8282-80526999b23a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:05.164392 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1d3e2b36-55f1-40d6-8282-80526999b23a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.145208 May 12 14:34:05.164959 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 150/314] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:05 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:05.379090 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-34b4ef5c-f608-446f-a159-56009f14c16f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:05.379708 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-34b4ef5c-f608-446f-a159-56009f14c16f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:05.385635 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34b4ef5c-f608-446f-a159-56009f14c16f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:05.386105 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34b4ef5c-f608-446f-a159-56009f14c16f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:05.386882 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34b4ef5c-f608-446f-a159-56009f14c16f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:05.387360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34b4ef5c-f608-446f-a159-56009f14c16f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:05.545263 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-34b4ef5c-f608-446f-a159-56009f14c16f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:05.554252 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-34b4ef5c-f608-446f-a159-56009f14c16f tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.179684 May 12 14:34:05.555386 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 165/315] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:05 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:05.619780 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9f61b069-b988-43bd-ae43-879f74af4ffe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:05.620431 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9f61b069-b988-43bd-ae43-879f74af4ffe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:05.622370 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-400a5693-bfdc-43d0-a6ea-81035c071058 req-8e3c06cc-f647-42f3-9fcd-0889e5eb8de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137403bd-302f-4ea4-aeba-782ade2358e0", "name": "network-vif-plugged", "status": "completed", "tag": "edce530e-0a2a-4073-b478-f2228ceb37bc"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:05.631346 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-400a5693-bfdc-43d0-a6ea-81035c071058 req-8e3c06cc-f647-42f3-9fcd-0889e5eb8de1 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:05.631580 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f61b069-b988-43bd-ae43-879f74af4ffe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:05.632069 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f61b069-b988-43bd-ae43-879f74af4ffe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:05.632530 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-400a5693-bfdc-43d0-a6ea-81035c071058 req-8e3c06cc-f647-42f3-9fcd-0889e5eb8de1 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:05.632875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f61b069-b988-43bd-ae43-879f74af4ffe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:05.633321 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f61b069-b988-43bd-ae43-879f74af4ffe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:05.646188 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-400a5693-bfdc-43d0-a6ea-81035c071058 req-8e3c06cc-f647-42f3-9fcd-0889e5eb8de1 service nova] Creating event network-vif-plugged:edce530e-0a2a-4073-b478-f2228ceb37bc for instance 137403bd-302f-4ea4-aeba-782ade2358e0 on hv-cinder-77703 May 12 14:34:05.651896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-400a5693-bfdc-43d0-a6ea-81035c071058 req-8e3c06cc-f647-42f3-9fcd-0889e5eb8de1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040484 May 12 14:34:05.653285 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 151/316] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:34:05.933317 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-981c5393-ed80-4702-8de4-a667c1c20fcf tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:05.934042 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-981c5393-ed80-4702-8de4-a667c1c20fcf tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:05.941011 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-981c5393-ed80-4702-8de4-a667c1c20fcf tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:05.941463 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-981c5393-ed80-4702-8de4-a667c1c20fcf tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:05.942489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-981c5393-ed80-4702-8de4-a667c1c20fcf tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:05.942919 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-981c5393-ed80-4702-8de4-a667c1c20fcf tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:06.020564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9f61b069-b988-43bd-ae43-879f74af4ffe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:06.027829 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9f61b069-b988-43bd-ae43-879f74af4ffe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1210 microversion: 2.1 time: 0.411799 May 12 14:34:06.028424 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 166/317] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:05 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1210 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:06.114562 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-981c5393-ed80-4702-8de4-a667c1c20fcf tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:06.121896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-981c5393-ed80-4702-8de4-a667c1c20fcf tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1468 microversion: 2.1 time: 0.193121 May 12 14:34:06.122466 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 152/318] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:05 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1468 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:06.180491 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f1792562-506e-4fd8-a9b3-9d78f9b101a2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:06.181101 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f1792562-506e-4fd8-a9b3-9d78f9b101a2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:06.187188 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1792562-506e-4fd8-a9b3-9d78f9b101a2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:06.187642 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1792562-506e-4fd8-a9b3-9d78f9b101a2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:06.188399 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1792562-506e-4fd8-a9b3-9d78f9b101a2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:06.188842 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1792562-506e-4fd8-a9b3-9d78f9b101a2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:06.317217 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f1792562-506e-4fd8-a9b3-9d78f9b101a2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:06.324534 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f1792562-506e-4fd8-a9b3-9d78f9b101a2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.147899 May 12 14:34:06.325105 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 167/319] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:06 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:06.571591 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d03225bf-b7f7-41a0-b290-d46eafb27328 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:06.572213 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d03225bf-b7f7-41a0-b290-d46eafb27328 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:06.578241 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d03225bf-b7f7-41a0-b290-d46eafb27328 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:06.579334 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d03225bf-b7f7-41a0-b290-d46eafb27328 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:06.581065 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d03225bf-b7f7-41a0-b290-d46eafb27328 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:06.581065 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d03225bf-b7f7-41a0-b290-d46eafb27328 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:06.736850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d03225bf-b7f7-41a0-b290-d46eafb27328 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:06.744205 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d03225bf-b7f7-41a0-b290-d46eafb27328 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.176416 May 12 14:34:06.744780 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 153/320] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:06 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:07.045223 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a07a07f0-fa4b-4138-966a-8f94a32b8203 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:07.045851 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a07a07f0-fa4b-4138-966a-8f94a32b8203 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:07.052645 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a07a07f0-fa4b-4138-966a-8f94a32b8203 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:07.053094 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a07a07f0-fa4b-4138-966a-8f94a32b8203 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:07.053877 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a07a07f0-fa4b-4138-966a-8f94a32b8203 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:07.054323 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a07a07f0-fa4b-4138-966a-8f94a32b8203 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:07.117049 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a07a07f0-fa4b-4138-966a-8f94a32b8203 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:07.124328 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a07a07f0-fa4b-4138-966a-8f94a32b8203 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1210 microversion: 2.1 time: 0.082922 May 12 14:34:07.125110 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 168/321] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:07 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:07.137992 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4bbef9c8-1fba-4a8a-a3c4-1e75530187f6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:07.138611 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4bbef9c8-1fba-4a8a-a3c4-1e75530187f6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:07.144937 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bbef9c8-1fba-4a8a-a3c4-1e75530187f6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:07.145387 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bbef9c8-1fba-4a8a-a3c4-1e75530187f6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:07.146154 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bbef9c8-1fba-4a8a-a3c4-1e75530187f6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:07.146589 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bbef9c8-1fba-4a8a-a3c4-1e75530187f6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:07.272516 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4bbef9c8-1fba-4a8a-a3c4-1e75530187f6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:07.279858 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4bbef9c8-1fba-4a8a-a3c4-1e75530187f6 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1468 microversion: 2.1 time: 0.145795 May 12 14:34:07.280441 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 154/322] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:07 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1468 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:07.341755 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4b448510-7de5-4ed6-87bf-110b1de5ba78 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:07.342401 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4b448510-7de5-4ed6-87bf-110b1de5ba78 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:07.349017 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4b448510-7de5-4ed6-87bf-110b1de5ba78 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:07.349473 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4b448510-7de5-4ed6-87bf-110b1de5ba78 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:07.350243 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4b448510-7de5-4ed6-87bf-110b1de5ba78 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:07.350684 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4b448510-7de5-4ed6-87bf-110b1de5ba78 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:07.478055 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4b448510-7de5-4ed6-87bf-110b1de5ba78 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:07.485628 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4b448510-7de5-4ed6-87bf-110b1de5ba78 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.147753 May 12 14:34:07.486199 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 169/323] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:07 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:07.761516 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bab1f276-d7a1-4151-853d-ee8f62ff8289 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:07.762055 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bab1f276-d7a1-4151-853d-ee8f62ff8289 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:07.768494 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bab1f276-d7a1-4151-853d-ee8f62ff8289 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:07.768949 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bab1f276-d7a1-4151-853d-ee8f62ff8289 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:07.769721 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bab1f276-d7a1-4151-853d-ee8f62ff8289 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:07.770162 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bab1f276-d7a1-4151-853d-ee8f62ff8289 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:07.909609 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bab1f276-d7a1-4151-853d-ee8f62ff8289 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:07.917155 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bab1f276-d7a1-4151-853d-ee8f62ff8289 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.159475 May 12 14:34:07.918019 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 155/324] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:07 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:08.140601 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4d8c8423-c8a4-41a6-a1eb-8f5c0804695c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:08.141914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4d8c8423-c8a4-41a6-a1eb-8f5c0804695c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:08.147896 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4d8c8423-c8a4-41a6-a1eb-8f5c0804695c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:08.148350 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4d8c8423-c8a4-41a6-a1eb-8f5c0804695c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:08.149123 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4d8c8423-c8a4-41a6-a1eb-8f5c0804695c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:08.149560 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4d8c8423-c8a4-41a6-a1eb-8f5c0804695c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:08.208253 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4d8c8423-c8a4-41a6-a1eb-8f5c0804695c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:08.215472 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4d8c8423-c8a4-41a6-a1eb-8f5c0804695c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1210 microversion: 2.1 time: 0.078750 May 12 14:34:08.216044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 170/325] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:08 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1210 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:08.297752 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-97819483-7340-44d5-b669-30b7c9a5e7cd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:08.298449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-97819483-7340-44d5-b669-30b7c9a5e7cd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:08.304693 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97819483-7340-44d5-b669-30b7c9a5e7cd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:08.305146 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97819483-7340-44d5-b669-30b7c9a5e7cd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:08.305910 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97819483-7340-44d5-b669-30b7c9a5e7cd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:08.306353 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97819483-7340-44d5-b669-30b7c9a5e7cd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:08.436816 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-97819483-7340-44d5-b669-30b7c9a5e7cd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:08.444877 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-97819483-7340-44d5-b669-30b7c9a5e7cd tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1468 microversion: 2.1 time: 0.151504 May 12 14:34:08.445578 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 156/326] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:08 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1468 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:08.502506 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f5dbcd53-24ad-42d5-93b9-5084bd45c297 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:08.503587 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f5dbcd53-24ad-42d5-93b9-5084bd45c297 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:08.509785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f5dbcd53-24ad-42d5-93b9-5084bd45c297 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:08.510242 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f5dbcd53-24ad-42d5-93b9-5084bd45c297 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:08.511087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f5dbcd53-24ad-42d5-93b9-5084bd45c297 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:08.511529 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f5dbcd53-24ad-42d5-93b9-5084bd45c297 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:08.643522 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f5dbcd53-24ad-42d5-93b9-5084bd45c297 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:08.652884 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f5dbcd53-24ad-42d5-93b9-5084bd45c297 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.154939 May 12 14:34:08.653464 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 171/327] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:08 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:08.934871 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-95c4870d-8494-4d8d-ad0c-769511711305 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:08.935954 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-95c4870d-8494-4d8d-ad0c-769511711305 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:08.942546 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-95c4870d-8494-4d8d-ad0c-769511711305 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:08.943285 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-95c4870d-8494-4d8d-ad0c-769511711305 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:08.944359 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-95c4870d-8494-4d8d-ad0c-769511711305 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:08.944840 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-95c4870d-8494-4d8d-ad0c-769511711305 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:09.070716 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-95c4870d-8494-4d8d-ad0c-769511711305 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:09.077953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-95c4870d-8494-4d8d-ad0c-769511711305 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.146996 May 12 14:34:09.079101 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 157/328] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:08 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:09.232217 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-bd3946df-eecc-4107-8c0a-03f80d84e218 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:09.232736 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-bd3946df-eecc-4107-8c0a-03f80d84e218 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:09.240206 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bd3946df-eecc-4107-8c0a-03f80d84e218 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:09.240654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bd3946df-eecc-4107-8c0a-03f80d84e218 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:09.241419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bd3946df-eecc-4107-8c0a-03f80d84e218 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:09.241854 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bd3946df-eecc-4107-8c0a-03f80d84e218 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:09.317923 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-bd3946df-eecc-4107-8c0a-03f80d84e218 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:09.330779 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-bd3946df-eecc-4107-8c0a-03f80d84e218 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1210 microversion: 2.1 time: 0.102184 May 12 14:34:09.332000 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 172/329] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:09 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:09.461738 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d6657ef3-c609-47c8-a7ae-0674bc4fe7f5 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:09.462333 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d6657ef3-c609-47c8-a7ae-0674bc4fe7f5 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:09.468586 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d6657ef3-c609-47c8-a7ae-0674bc4fe7f5 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:09.469677 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d6657ef3-c609-47c8-a7ae-0674bc4fe7f5 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:09.470444 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d6657ef3-c609-47c8-a7ae-0674bc4fe7f5 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:09.470881 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d6657ef3-c609-47c8-a7ae-0674bc4fe7f5 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:09.595767 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d6657ef3-c609-47c8-a7ae-0674bc4fe7f5 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:09.602908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d6657ef3-c609-47c8-a7ae-0674bc4fe7f5 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1468 microversion: 2.1 time: 0.145097 May 12 14:34:09.603508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 158/330] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:09 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1468 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:09.669801 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f1e18154-53d7-4fd6-a31f-5ba6729c22f6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:09.670418 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f1e18154-53d7-4fd6-a31f-5ba6729c22f6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:09.676841 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1e18154-53d7-4fd6-a31f-5ba6729c22f6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:09.677312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1e18154-53d7-4fd6-a31f-5ba6729c22f6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:09.678255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1e18154-53d7-4fd6-a31f-5ba6729c22f6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:09.678701 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1e18154-53d7-4fd6-a31f-5ba6729c22f6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:09.803447 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f1e18154-53d7-4fd6-a31f-5ba6729c22f6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:09.810867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f1e18154-53d7-4fd6-a31f-5ba6729c22f6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.144941 May 12 14:34:09.811482 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 173/331] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:09 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:10.095555 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4bc60aa7-5fdb-462b-8815-9a9dda17055d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:10.096171 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4bc60aa7-5fdb-462b-8815-9a9dda17055d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:10.102316 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bc60aa7-5fdb-462b-8815-9a9dda17055d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:10.102774 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bc60aa7-5fdb-462b-8815-9a9dda17055d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:10.103599 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bc60aa7-5fdb-462b-8815-9a9dda17055d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:10.104039 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bc60aa7-5fdb-462b-8815-9a9dda17055d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:10.233826 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4bc60aa7-5fdb-462b-8815-9a9dda17055d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:10.240994 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4bc60aa7-5fdb-462b-8815-9a9dda17055d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1318 microversion: 2.1 time: 0.149274 May 12 14:34:10.241577 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 159/332] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:10 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:10.355838 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c566cf3a-dc09-47c2-9a37-47a512befb40 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:10.356397 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c566cf3a-dc09-47c2-9a37-47a512befb40 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:10.362423 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c566cf3a-dc09-47c2-9a37-47a512befb40 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:10.362879 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c566cf3a-dc09-47c2-9a37-47a512befb40 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:10.363711 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c566cf3a-dc09-47c2-9a37-47a512befb40 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:10.364155 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c566cf3a-dc09-47c2-9a37-47a512befb40 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:10.425627 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c566cf3a-dc09-47c2-9a37-47a512befb40 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:10.433002 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c566cf3a-dc09-47c2-9a37-47a512befb40 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1210 microversion: 2.1 time: 0.081135 May 12 14:34:10.433571 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 174/333] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:10 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1210 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:10.621310 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a7a69bce-94ed-4a03-a9c6-d40a74d91263 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:10.621834 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a7a69bce-94ed-4a03-a9c6-d40a74d91263 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:10.629243 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a7a69bce-94ed-4a03-a9c6-d40a74d91263 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:10.629697 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a7a69bce-94ed-4a03-a9c6-d40a74d91263 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:10.630509 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a7a69bce-94ed-4a03-a9c6-d40a74d91263 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:10.630950 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a7a69bce-94ed-4a03-a9c6-d40a74d91263 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:10.758749 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a7a69bce-94ed-4a03-a9c6-d40a74d91263 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:10.766494 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a7a69bce-94ed-4a03-a9c6-d40a74d91263 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1468 microversion: 2.1 time: 0.149104 May 12 14:34:10.767119 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 160/334] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:10 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1468 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:10.826762 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c82f1838-278b-4c86-b64c-eb147d59fd1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:10.827487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c82f1838-278b-4c86-b64c-eb147d59fd1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:10.833568 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c82f1838-278b-4c86-b64c-eb147d59fd1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:10.834019 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c82f1838-278b-4c86-b64c-eb147d59fd1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:10.834789 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c82f1838-278b-4c86-b64c-eb147d59fd1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:10.835382 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c82f1838-278b-4c86-b64c-eb147d59fd1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:10.900194 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-15a17bea-bb65-4e6d-a17a-91d1cb678d1b req-245e3e0e-0ed4-4b5b-b387-ca05e30f398d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8855245c-3865-4c1b-8dd4-da43c780113e", "name": "network-vif-unplugged", "status": "completed", "tag": "f636a2b1-87e8-46f9-b1ec-23fa693c4a57"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:10.910006 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-15a17bea-bb65-4e6d-a17a-91d1cb678d1b req-245e3e0e-0ed4-4b5b-b387-ca05e30f398d service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:10.910695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-15a17bea-bb65-4e6d-a17a-91d1cb678d1b req-245e3e0e-0ed4-4b5b-b387-ca05e30f398d service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:10.923350 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-15a17bea-bb65-4e6d-a17a-91d1cb678d1b req-245e3e0e-0ed4-4b5b-b387-ca05e30f398d service nova] Creating event network-vif-unplugged:f636a2b1-87e8-46f9-b1ec-23fa693c4a57 for instance 8855245c-3865-4c1b-8dd4-da43c780113e on hv-cinder-77703 May 12 14:34:10.928567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-15a17bea-bb65-4e6d-a17a-91d1cb678d1b req-245e3e0e-0ed4-4b5b-b387-ca05e30f398d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032107 May 12 14:34:10.929680 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 161/335] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:34:11.102097 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c82f1838-278b-4c86-b64c-eb147d59fd1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:11.112053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c82f1838-278b-4c86-b64c-eb147d59fd1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.289037 May 12 14:34:11.112742 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 175/336] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:10 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:11.258532 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-38708a54-e604-4fa4-95d5-1fa97af2938a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:11.259273 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-38708a54-e604-4fa4-95d5-1fa97af2938a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:11.265225 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-38708a54-e604-4fa4-95d5-1fa97af2938a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:11.266253 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-38708a54-e604-4fa4-95d5-1fa97af2938a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:11.267018 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-38708a54-e604-4fa4-95d5-1fa97af2938a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:11.267476 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-38708a54-e604-4fa4-95d5-1fa97af2938a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:11.449906 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8aa1727f-ca41-424a-b096-95c2c155cf37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:11.450436 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-8aa1727f-ca41-424a-b096-95c2c155cf37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:11.456757 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8aa1727f-ca41-424a-b096-95c2c155cf37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:11.457211 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8aa1727f-ca41-424a-b096-95c2c155cf37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:11.457994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8aa1727f-ca41-424a-b096-95c2c155cf37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:11.458434 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8aa1727f-ca41-424a-b096-95c2c155cf37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:11.483859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-38708a54-e604-4fa4-95d5-1fa97af2938a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:11.491509 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-38708a54-e604-4fa4-95d5-1fa97af2938a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1506 microversion: 2.1 time: 0.237125 May 12 14:34:11.492216 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 162/337] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:11 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:11.533921 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8aa1727f-ca41-424a-b096-95c2c155cf37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:11.542532 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8aa1727f-ca41-424a-b096-95c2c155cf37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1210 microversion: 2.1 time: 0.096753 May 12 14:34:11.551966 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 176/338] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:11 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:11.783354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9e30a5ff-4c89-4fe5-ad6a-06c51c97dfab tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:11.784815 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9e30a5ff-4c89-4fe5-ad6a-06c51c97dfab tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:11.792724 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9e30a5ff-4c89-4fe5-ad6a-06c51c97dfab tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:11.793517 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9e30a5ff-4c89-4fe5-ad6a-06c51c97dfab tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:11.794251 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9e30a5ff-4c89-4fe5-ad6a-06c51c97dfab tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:11.794706 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9e30a5ff-4c89-4fe5-ad6a-06c51c97dfab tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:12.130058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a0dec240-ae5b-451c-beab-4ddc689c4fdc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:12.130831 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a0dec240-ae5b-451c-beab-4ddc689c4fdc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:12.138189 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a0dec240-ae5b-451c-beab-4ddc689c4fdc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:12.138719 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a0dec240-ae5b-451c-beab-4ddc689c4fdc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:12.139980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a0dec240-ae5b-451c-beab-4ddc689c4fdc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:12.140493 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a0dec240-ae5b-451c-beab-4ddc689c4fdc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:12.185411 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9e30a5ff-4c89-4fe5-ad6a-06c51c97dfab tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:12.193332 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9e30a5ff-4c89-4fe5-ad6a-06c51c97dfab tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1468 microversion: 2.1 time: 0.414191 May 12 14:34:12.194353 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 163/339] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:11 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1468 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:12.491252 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a0dec240-ae5b-451c-beab-4ddc689c4fdc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:12.499795 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a0dec240-ae5b-451c-beab-4ddc689c4fdc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.374903 May 12 14:34:12.500682 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 177/340] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:12 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:12.566729 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-01c713ff-c92b-45c4-ad55-354b59203277 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:12.567672 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-01c713ff-c92b-45c4-ad55-354b59203277 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:12.578468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-01c713ff-c92b-45c4-ad55-354b59203277 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:12.581379 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-01c713ff-c92b-45c4-ad55-354b59203277 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:12.582382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-01c713ff-c92b-45c4-ad55-354b59203277 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:12.582848 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-01c713ff-c92b-45c4-ad55-354b59203277 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:12.826212 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-314f3aa7-75f7-4dfd-945b-62c043ca412b req-73b6b01e-0e8d-43c3-be94-7334adbc9003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8855245c-3865-4c1b-8dd4-da43c780113e", "name": "network-vif-deleted", "tag": "f636a2b1-87e8-46f9-b1ec-23fa693c4a57"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:12.836665 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-314f3aa7-75f7-4dfd-945b-62c043ca412b req-73b6b01e-0e8d-43c3-be94-7334adbc9003 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:12.837316 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-314f3aa7-75f7-4dfd-945b-62c043ca412b req-73b6b01e-0e8d-43c3-be94-7334adbc9003 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:12.853076 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-314f3aa7-75f7-4dfd-945b-62c043ca412b req-73b6b01e-0e8d-43c3-be94-7334adbc9003 service nova] Creating event network-vif-deleted:f636a2b1-87e8-46f9-b1ec-23fa693c4a57 for instance 8855245c-3865-4c1b-8dd4-da43c780113e on hv-cinder-77703 May 12 14:34:12.860349 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-314f3aa7-75f7-4dfd-945b-62c043ca412b req-73b6b01e-0e8d-43c3-be94-7334adbc9003 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038443 May 12 14:34:12.860965 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 178/341] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:34:12.906924 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-01c713ff-c92b-45c4-ad55-354b59203277 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:12.914818 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-01c713ff-c92b-45c4-ad55-354b59203277 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1278 microversion: 2.1 time: 0.356973 May 12 14:34:12.915993 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 164/342] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:12 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1278 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:13.213130 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8cc8cd3b-ade0-4aca-8fbe-4ca37e7fd54f tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:13.213843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-8cc8cd3b-ade0-4aca-8fbe-4ca37e7fd54f tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:13.220596 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8cc8cd3b-ade0-4aca-8fbe-4ca37e7fd54f tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:13.220991 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8cc8cd3b-ade0-4aca-8fbe-4ca37e7fd54f tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:13.221815 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8cc8cd3b-ade0-4aca-8fbe-4ca37e7fd54f tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:13.222255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8cc8cd3b-ade0-4aca-8fbe-4ca37e7fd54f tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:13.291707 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8cc8cd3b-ade0-4aca-8fbe-4ca37e7fd54f tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:13.299281 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8cc8cd3b-ade0-4aca-8fbe-4ca37e7fd54f tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1426 microversion: 2.1 time: 0.091719 May 12 14:34:13.299922 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 179/343] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:13 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1426 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:13.518706 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9b968034-edf1-4ca4-acf4-3f835ee2d393 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:13.519344 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9b968034-edf1-4ca4-acf4-3f835ee2d393 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:13.526180 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9b968034-edf1-4ca4-acf4-3f835ee2d393 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:13.526643 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9b968034-edf1-4ca4-acf4-3f835ee2d393 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:13.527743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9b968034-edf1-4ca4-acf4-3f835ee2d393 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:13.528196 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9b968034-edf1-4ca4-acf4-3f835ee2d393 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:13.706010 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9b968034-edf1-4ca4-acf4-3f835ee2d393 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:13.713835 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9b968034-edf1-4ca4-acf4-3f835ee2d393 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1321 microversion: 2.1 time: 0.199457 May 12 14:34:13.714527 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 165/344] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:13 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:13.933089 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3f81930d-85a1-4ea5-8f0a-d963f333cc1f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:13.933736 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3f81930d-85a1-4ea5-8f0a-d963f333cc1f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:13.940175 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3f81930d-85a1-4ea5-8f0a-d963f333cc1f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:13.940624 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3f81930d-85a1-4ea5-8f0a-d963f333cc1f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:13.941448 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3f81930d-85a1-4ea5-8f0a-d963f333cc1f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:13.941914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3f81930d-85a1-4ea5-8f0a-d963f333cc1f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:14.075896 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3f81930d-85a1-4ea5-8f0a-d963f333cc1f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:14.094436 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3f81930d-85a1-4ea5-8f0a-d963f333cc1f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.164474 May 12 14:34:14.095448 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 180/345] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:13 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:14.316313 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-48b7658a-f551-4864-b00d-587e627d10dc tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:14.317219 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-48b7658a-f551-4864-b00d-587e627d10dc tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:14.323548 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-48b7658a-f551-4864-b00d-587e627d10dc tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:14.323903 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-48b7658a-f551-4864-b00d-587e627d10dc tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:14.324749 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-48b7658a-f551-4864-b00d-587e627d10dc tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:14.325100 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-48b7658a-f551-4864-b00d-587e627d10dc tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:14.357944 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-48b7658a-f551-4864-b00d-587e627d10dc tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:14.358404 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-48b7658a-f551-4864-b00d-587e627d10dc tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:14.358871 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-48b7658a-f551-4864-b00d-587e627d10dc tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lazy-loading 'fault' on Instance uuid 8855245c-3865-4c1b-8dd4-da43c780113e {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:34:14.401856 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-48b7658a-f551-4864-b00d-587e627d10dc tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b98d85325b4ea194c06848e508ad7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2089564feda44bac86715eed2cf285f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:14.409796 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-48b7658a-f551-4864-b00d-587e627d10dc tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 200 len: 1303 microversion: 2.1 time: 0.097428 May 12 14:34:14.410364 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 166/346] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:14 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:14.731724 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-867d92b0-a0df-42aa-aa54-a43d96e75d43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:14.732259 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-867d92b0-a0df-42aa-aa54-a43d96e75d43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:14.738447 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-867d92b0-a0df-42aa-aa54-a43d96e75d43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:14.738901 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-867d92b0-a0df-42aa-aa54-a43d96e75d43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:14.739952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-867d92b0-a0df-42aa-aa54-a43d96e75d43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:14.740461 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-867d92b0-a0df-42aa-aa54-a43d96e75d43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:14.884159 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-b6b97265-5490-4718-a255-4dba6dd6713e req-da7cb5af-87ce-4ba2-a3e4-89fde9fb7eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b53d1801-00ff-4886-8632-1d02c3275dd5", "tag": "e20769a6-986c-4bef-a558-db20551da4d2"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:14.895976 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-b6b97265-5490-4718-a255-4dba6dd6713e req-da7cb5af-87ce-4ba2-a3e4-89fde9fb7eb4 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:14.896524 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-b6b97265-5490-4718-a255-4dba6dd6713e req-da7cb5af-87ce-4ba2-a3e4-89fde9fb7eb4 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:14.910115 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-b6b97265-5490-4718-a255-4dba6dd6713e req-da7cb5af-87ce-4ba2-a3e4-89fde9fb7eb4 service nova] Creating event network-changed:e20769a6-986c-4bef-a558-db20551da4d2 for instance b53d1801-00ff-4886-8632-1d02c3275dd5 on hv-cinder-77703 May 12 14:34:14.915572 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-867d92b0-a0df-42aa-aa54-a43d96e75d43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:14.915869 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-b6b97265-5490-4718-a255-4dba6dd6713e req-da7cb5af-87ce-4ba2-a3e4-89fde9fb7eb4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034792 May 12 14:34:14.916558 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 167/347] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:34:14.924283 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-867d92b0-a0df-42aa-aa54-a43d96e75d43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1516 microversion: 2.1 time: 0.196792 May 12 14:34:14.924853 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 181/348] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:14 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:14.944524 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9d48f4ac-d6b1-408f-953d-4f490e45e3e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:14.945893 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9d48f4ac-d6b1-408f-953d-4f490e45e3e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:14.952832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9d48f4ac-d6b1-408f-953d-4f490e45e3e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:14.953211 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9d48f4ac-d6b1-408f-953d-4f490e45e3e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:14.953983 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9d48f4ac-d6b1-408f-953d-4f490e45e3e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:14.955488 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9d48f4ac-d6b1-408f-953d-4f490e45e3e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:14.979758 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-9d48f4ac-d6b1-408f-953d-4f490e45e3e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lazy-loading 'flavor' on Instance uuid 137403bd-302f-4ea4-aeba-782ade2358e0 {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:34:15.095344 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9d48f4ac-d6b1-408f-953d-4f490e45e3e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "POST /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0/action" status: 200 len: 32 microversion: 2.1 time: 0.156244 May 12 14:34:15.095952 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 168/349] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 12 14:34:14 2022] POST /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:34:15.104807 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-173c66a2-65d1-4e71-becf-92c306d0950d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:15.105422 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-173c66a2-65d1-4e71-becf-92c306d0950d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:15.111978 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-173c66a2-65d1-4e71-becf-92c306d0950d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:15.112436 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-173c66a2-65d1-4e71-becf-92c306d0950d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:15.112566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-35941d04-d2ad-44b9-95d3-722a7a0bf30e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:15.113157 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-35941d04-d2ad-44b9-95d3-722a7a0bf30e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:15.113265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-173c66a2-65d1-4e71-becf-92c306d0950d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:15.113639 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-173c66a2-65d1-4e71-becf-92c306d0950d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:15.122223 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-35941d04-d2ad-44b9-95d3-722a7a0bf30e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:15.122675 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-35941d04-d2ad-44b9-95d3-722a7a0bf30e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:15.123476 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-35941d04-d2ad-44b9-95d3-722a7a0bf30e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:15.123929 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-35941d04-d2ad-44b9-95d3-722a7a0bf30e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:15.433815 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-173c66a2-65d1-4e71-becf-92c306d0950d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:15.442240 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-173c66a2-65d1-4e71-becf-92c306d0950d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.341149 May 12 14:34:15.442855 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 182/350] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:15 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:15.445987 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-35941d04-d2ad-44b9-95d3-722a7a0bf30e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:15.451957 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-668eb25f-ec15-4a0f-8f0e-e7fc191df948 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:15.452951 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-668eb25f-ec15-4a0f-8f0e-e7fc191df948 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] [instance: 8855245c-3865-4c1b-8dd4-da43c780113e] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:15.453697 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-35941d04-d2ad-44b9-95d3-722a7a0bf30e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.345972 May 12 14:34:15.454273 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 169/351] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:15 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:15.460068 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-668eb25f-ec15-4a0f-8f0e-e7fc191df948 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:15.460535 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-668eb25f-ec15-4a0f-8f0e-e7fc191df948 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:15.461407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-668eb25f-ec15-4a0f-8f0e-e7fc191df948 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:15.461817 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-668eb25f-ec15-4a0f-8f0e-e7fc191df948 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:15.476449 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-668eb25f-ec15-4a0f-8f0e-e7fc191df948 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] HTTP exception thrown: Instance 8855245c-3865-4c1b-8dd4-da43c780113e could not be found. May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-668eb25f-ec15-4a0f-8f0e-e7fc191df948 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Request method failure captured: May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e HTTP/1.1 May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRqwCfr0oRi_jYjp4uzGxgOHGIAxVuilVn9eEc75cyVyzgIAFk1sFxhPLWq15KhhQneN5QLWcMu_wSh9gaaX0exEnLPCAETwRRl7_WuodoWLZQkyQ9lDWGIBSFyCrcBkQ_OUcI_3vpPxTMwN0BlOObHpOUwWSGT66ZRTh4fF-UWuWTs May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 2089564feda44bac86715eed2cf285f1 May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-VolumesNegativeTest-115256952 May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:34:15.478115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:34:15.479738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/2089564feda44bac86715eed2cf285f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2089564feda44bac86715eed2cf285f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_2089564feda44bac86715eed2cf285f1", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2089564feda44bac86715eed2cf285f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:34:15.479738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-VolumesNegativeTest-115256952 May 12 14:34:15.479738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 2089564feda44bac86715eed2cf285f1 May 12 14:34:15.479738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-VolumesNegativeTest-115256952 May 12 14:34:15.479738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-VolumesNegativeTest-115256952-project May 12 14:34:15.479738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:34:15.479738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:34:15.479738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: 34b98d85325b4ea194c06848e508ad7a May 12 14:34:15.479738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-VolumesNegativeTest-115256952-project May 12 14:34:15.479738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:34:15.479738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance 8855245c-3865-4c1b-8dd4-da43c780113e could not be found. May 12 14:34:15.479738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '8855245c-3865-4c1b-8dd4-da43c780113e'} May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8855245c-3865-4c1b-8dd4-da43c780113e could not be found. May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:34:15.483564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8855245c-3865-4c1b-8dd4-da43c780113e could not be found. May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8855245c-3865-4c1b-8dd4-da43c780113e could not be found. May 12 14:34:15.485516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:34:15.486679 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-668eb25f-ec15-4a0f-8f0e-e7fc191df948 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] Returning 404 to user: Instance 8855245c-3865-4c1b-8dd4-da43c780113e could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:34:15.486679 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-668eb25f-ec15-4a0f-8f0e-e7fc191df948 tempest-VolumesNegativeTest-115256952 tempest-VolumesNegativeTest-115256952-project] 10.222.0.75 "GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e" status: 404 len: 111 microversion: 2.1 time: 0.034926 May 12 14:34:15.486679 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 183/352] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:15 2022] GET /compute/v2.1/servers/8855245c-3865-4c1b-8dd4-da43c780113e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:34:16.459974 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-6495a243-eacb-4cd1-bf05-1e2e2eb8fade tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:16.460803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-6495a243-eacb-4cd1-bf05-1e2e2eb8fade tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:16.467603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6495a243-eacb-4cd1-bf05-1e2e2eb8fade tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:16.468362 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6495a243-eacb-4cd1-bf05-1e2e2eb8fade tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:16.469961 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6495a243-eacb-4cd1-bf05-1e2e2eb8fade tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:16.472957 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6495a243-eacb-4cd1-bf05-1e2e2eb8fade tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:16.473338 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f7165e3b-7913-459b-8b0a-268cbc621c37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:16.474291 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f7165e3b-7913-459b-8b0a-268cbc621c37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:16.481398 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f7165e3b-7913-459b-8b0a-268cbc621c37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:16.482226 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f7165e3b-7913-459b-8b0a-268cbc621c37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:16.483836 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f7165e3b-7913-459b-8b0a-268cbc621c37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:16.484536 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f7165e3b-7913-459b-8b0a-268cbc621c37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:16.694922 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-6495a243-eacb-4cd1-bf05-1e2e2eb8fade tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:16.705195 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-6495a243-eacb-4cd1-bf05-1e2e2eb8fade tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.249000 May 12 14:34:16.705784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 170/353] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:16 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:16.710326 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f7165e3b-7913-459b-8b0a-268cbc621c37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:16.719557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f7165e3b-7913-459b-8b0a-268cbc621c37 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.252463 May 12 14:34:16.721250 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 184/354] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:16 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:17.721897 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-51e30cbb-0f15-45d8-860b-a864749dc653 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:17.722526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-51e30cbb-0f15-45d8-860b-a864749dc653 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:17.729108 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-51e30cbb-0f15-45d8-860b-a864749dc653 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:17.729572 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-51e30cbb-0f15-45d8-860b-a864749dc653 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:17.730357 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-51e30cbb-0f15-45d8-860b-a864749dc653 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:17.730799 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-51e30cbb-0f15-45d8-860b-a864749dc653 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:17.736448 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c80d1cd7-4f2e-42e0-8323-c161792868be tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:17.737052 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c80d1cd7-4f2e-42e0-8323-c161792868be tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:17.743285 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c80d1cd7-4f2e-42e0-8323-c161792868be tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:17.743743 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c80d1cd7-4f2e-42e0-8323-c161792868be tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:17.744523 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c80d1cd7-4f2e-42e0-8323-c161792868be tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:17.744962 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c80d1cd7-4f2e-42e0-8323-c161792868be tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:18.200619 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c80d1cd7-4f2e-42e0-8323-c161792868be tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:18.219373 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c80d1cd7-4f2e-42e0-8323-c161792868be tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.486598 May 12 14:34:18.219964 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 185/355] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:17 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:18.220223 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-51e30cbb-0f15-45d8-860b-a864749dc653 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:18.228608 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-51e30cbb-0f15-45d8-860b-a864749dc653 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.510890 May 12 14:34:18.229741 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 171/356] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:17 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:19.236043 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ecfeb499-6467-430e-8b6f-f8c14476b74d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:19.236581 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ecfeb499-6467-430e-8b6f-f8c14476b74d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:19.242548 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ecfeb499-6467-430e-8b6f-f8c14476b74d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:19.243207 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ecfeb499-6467-430e-8b6f-f8c14476b74d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:19.244271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ecfeb499-6467-430e-8b6f-f8c14476b74d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:19.244705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ecfeb499-6467-430e-8b6f-f8c14476b74d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:19.248713 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-dfc3298f-236e-4d18-a277-2f303b607cb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:19.249336 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-dfc3298f-236e-4d18-a277-2f303b607cb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:19.257013 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dfc3298f-236e-4d18-a277-2f303b607cb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:19.257474 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dfc3298f-236e-4d18-a277-2f303b607cb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:19.259734 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dfc3298f-236e-4d18-a277-2f303b607cb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:19.260182 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dfc3298f-236e-4d18-a277-2f303b607cb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:19.431597 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ecfeb499-6467-430e-8b6f-f8c14476b74d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:19.439839 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ecfeb499-6467-430e-8b6f-f8c14476b74d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.207788 May 12 14:34:19.440589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 186/357] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:19 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:19.455648 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-dfc3298f-236e-4d18-a277-2f303b607cb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:19.462868 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-dfc3298f-236e-4d18-a277-2f303b607cb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.217934 May 12 14:34:19.463479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 172/358] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:19 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:20.459539 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-22d37863-0ddf-4564-a165-58d2cec4f541 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:20.460237 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-22d37863-0ddf-4564-a165-58d2cec4f541 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:20.466294 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-22d37863-0ddf-4564-a165-58d2cec4f541 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:20.466826 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-22d37863-0ddf-4564-a165-58d2cec4f541 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:20.467697 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-22d37863-0ddf-4564-a165-58d2cec4f541 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:20.468228 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-22d37863-0ddf-4564-a165-58d2cec4f541 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:20.480005 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-6f574dec-cb46-437b-9c41-09f0d77fb883 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:20.481777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-6f574dec-cb46-437b-9c41-09f0d77fb883 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:20.489693 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6f574dec-cb46-437b-9c41-09f0d77fb883 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:20.490416 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6f574dec-cb46-437b-9c41-09f0d77fb883 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:20.491425 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6f574dec-cb46-437b-9c41-09f0d77fb883 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:20.491857 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6f574dec-cb46-437b-9c41-09f0d77fb883 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:20.682914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-22d37863-0ddf-4564-a165-58d2cec4f541 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:20.693032 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-22d37863-0ddf-4564-a165-58d2cec4f541 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.237661 May 12 14:34:20.695384 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 187/359] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:20 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:20.714803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-6f574dec-cb46-437b-9c41-09f0d77fb883 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:20.722003 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-6f574dec-cb46-437b-9c41-09f0d77fb883 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.246397 May 12 14:34:20.722573 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 173/360] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:20 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:21.714156 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0798a10a-e6d1-42ab-8212-eb1e4a5dc5f8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:21.714780 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0798a10a-e6d1-42ab-8212-eb1e4a5dc5f8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:21.721824 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0798a10a-e6d1-42ab-8212-eb1e4a5dc5f8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:21.722286 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0798a10a-e6d1-42ab-8212-eb1e4a5dc5f8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:21.723127 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0798a10a-e6d1-42ab-8212-eb1e4a5dc5f8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:21.723582 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0798a10a-e6d1-42ab-8212-eb1e4a5dc5f8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:21.737664 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-871c933b-d9c9-4caf-aa01-a5242639ff7f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:21.738290 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-871c933b-d9c9-4caf-aa01-a5242639ff7f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:21.747367 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-871c933b-d9c9-4caf-aa01-a5242639ff7f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:21.747824 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-871c933b-d9c9-4caf-aa01-a5242639ff7f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:21.748746 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-871c933b-d9c9-4caf-aa01-a5242639ff7f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:21.749077 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-871c933b-d9c9-4caf-aa01-a5242639ff7f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:22.110653 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0798a10a-e6d1-42ab-8212-eb1e4a5dc5f8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:22.118089 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0798a10a-e6d1-42ab-8212-eb1e4a5dc5f8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.408125 May 12 14:34:22.118874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 188/361] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:21 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:22.132848 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-871c933b-d9c9-4caf-aa01-a5242639ff7f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:22.142259 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-871c933b-d9c9-4caf-aa01-a5242639ff7f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.408377 May 12 14:34:22.145725 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 174/362] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:21 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:23.135703 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-57a45644-e68d-40b2-914f-9154c8d77979 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:23.136948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-57a45644-e68d-40b2-914f-9154c8d77979 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:23.143694 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57a45644-e68d-40b2-914f-9154c8d77979 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:23.144079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57a45644-e68d-40b2-914f-9154c8d77979 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:23.145126 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57a45644-e68d-40b2-914f-9154c8d77979 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:23.145639 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57a45644-e68d-40b2-914f-9154c8d77979 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:23.162346 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-164afb1a-a7dd-4ce2-9795-cef1c3157b67 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:23.163965 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-164afb1a-a7dd-4ce2-9795-cef1c3157b67 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:23.178725 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-164afb1a-a7dd-4ce2-9795-cef1c3157b67 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:23.179590 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-164afb1a-a7dd-4ce2-9795-cef1c3157b67 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:23.180471 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-164afb1a-a7dd-4ce2-9795-cef1c3157b67 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:23.180990 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-164afb1a-a7dd-4ce2-9795-cef1c3157b67 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:23.402505 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-57a45644-e68d-40b2-914f-9154c8d77979 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:23.411109 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-57a45644-e68d-40b2-914f-9154c8d77979 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.279068 May 12 14:34:23.411795 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 189/363] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:23 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:23.457451 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-164afb1a-a7dd-4ce2-9795-cef1c3157b67 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:23.465208 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-164afb1a-a7dd-4ce2-9795-cef1c3157b67 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.306816 May 12 14:34:23.466155 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 175/364] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:23 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:24.446077 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-faa6f756-3598-40a7-bf65-bd15961b2890 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:24.449776 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-faa6f756-3598-40a7-bf65-bd15961b2890 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:24.470638 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-faa6f756-3598-40a7-bf65-bd15961b2890 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:24.471886 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-faa6f756-3598-40a7-bf65-bd15961b2890 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:24.476575 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-faa6f756-3598-40a7-bf65-bd15961b2890 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:24.477798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-faa6f756-3598-40a7-bf65-bd15961b2890 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:24.488318 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c9f671eb-6e54-4faf-8f89-5b421eb71f63 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:24.489246 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c9f671eb-6e54-4faf-8f89-5b421eb71f63 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:24.506024 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c9f671eb-6e54-4faf-8f89-5b421eb71f63 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:24.506024 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c9f671eb-6e54-4faf-8f89-5b421eb71f63 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:24.506397 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c9f671eb-6e54-4faf-8f89-5b421eb71f63 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:24.506841 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c9f671eb-6e54-4faf-8f89-5b421eb71f63 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:24.742382 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-faa6f756-3598-40a7-bf65-bd15961b2890 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:24.756030 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-faa6f756-3598-40a7-bf65-bd15961b2890 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.330227 May 12 14:34:24.766680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 190/365] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:24 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:24.797378 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c9f671eb-6e54-4faf-8f89-5b421eb71f63 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:24.806110 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c9f671eb-6e54-4faf-8f89-5b421eb71f63 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.322084 May 12 14:34:24.808694 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 176/366] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:24 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:25.773624 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4e1ff2ce-7683-4358-bf23-3ea2586603e9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:25.774519 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4e1ff2ce-7683-4358-bf23-3ea2586603e9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:25.781768 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4e1ff2ce-7683-4358-bf23-3ea2586603e9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:25.785397 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4e1ff2ce-7683-4358-bf23-3ea2586603e9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:25.786811 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4e1ff2ce-7683-4358-bf23-3ea2586603e9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:25.788130 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4e1ff2ce-7683-4358-bf23-3ea2586603e9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:25.836371 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a9db93e8-85dd-4b31-9ecb-507327484cb2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:25.837922 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a9db93e8-85dd-4b31-9ecb-507327484cb2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:25.848516 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a9db93e8-85dd-4b31-9ecb-507327484cb2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:25.849069 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a9db93e8-85dd-4b31-9ecb-507327484cb2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:25.849960 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a9db93e8-85dd-4b31-9ecb-507327484cb2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:25.850498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a9db93e8-85dd-4b31-9ecb-507327484cb2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:26.031904 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4e1ff2ce-7683-4358-bf23-3ea2586603e9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:26.039884 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4e1ff2ce-7683-4358-bf23-3ea2586603e9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.271483 May 12 14:34:26.040810 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 191/367] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:25 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:26.061986 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a9db93e8-85dd-4b31-9ecb-507327484cb2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:26.070009 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a9db93e8-85dd-4b31-9ecb-507327484cb2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.239372 May 12 14:34:26.070777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 177/368] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:25 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:27.057553 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3b207d09-4128-4c43-bd1b-c0ced5b72425 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:27.058175 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3b207d09-4128-4c43-bd1b-c0ced5b72425 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:27.064156 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3b207d09-4128-4c43-bd1b-c0ced5b72425 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:27.064610 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3b207d09-4128-4c43-bd1b-c0ced5b72425 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:27.065396 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3b207d09-4128-4c43-bd1b-c0ced5b72425 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:27.065842 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3b207d09-4128-4c43-bd1b-c0ced5b72425 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:27.086683 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-70d05b66-ab87-450a-97c4-20660f4494a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:27.087246 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-70d05b66-ab87-450a-97c4-20660f4494a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:27.097842 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-70d05b66-ab87-450a-97c4-20660f4494a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:27.098654 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-70d05b66-ab87-450a-97c4-20660f4494a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:27.099737 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-70d05b66-ab87-450a-97c4-20660f4494a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:27.107546 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-70d05b66-ab87-450a-97c4-20660f4494a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:27.416741 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3b207d09-4128-4c43-bd1b-c0ced5b72425 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:27.425586 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3b207d09-4128-4c43-bd1b-c0ced5b72425 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.371930 May 12 14:34:27.435229 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 192/369] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:27 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:27.459933 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-70d05b66-ab87-450a-97c4-20660f4494a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:27.469289 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-70d05b66-ab87-450a-97c4-20660f4494a5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.386425 May 12 14:34:27.470522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 178/370] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:27 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:28.441867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-fa36ac66-1667-481b-8e15-efd08b807225 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:28.442483 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-fa36ac66-1667-481b-8e15-efd08b807225 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:28.448863 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fa36ac66-1667-481b-8e15-efd08b807225 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:28.449356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fa36ac66-1667-481b-8e15-efd08b807225 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:28.450141 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fa36ac66-1667-481b-8e15-efd08b807225 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:28.450588 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fa36ac66-1667-481b-8e15-efd08b807225 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:28.485509 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-465c7f5f-5b2f-4867-85cc-cdd27cbfa024 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:28.486721 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-465c7f5f-5b2f-4867-85cc-cdd27cbfa024 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:28.492809 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-465c7f5f-5b2f-4867-85cc-cdd27cbfa024 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:28.493264 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-465c7f5f-5b2f-4867-85cc-cdd27cbfa024 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:28.494053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-465c7f5f-5b2f-4867-85cc-cdd27cbfa024 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:28.494501 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-465c7f5f-5b2f-4867-85cc-cdd27cbfa024 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:28.798501 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-fa36ac66-1667-481b-8e15-efd08b807225 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:28.813240 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-fa36ac66-1667-481b-8e15-efd08b807225 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.375143 May 12 14:34:28.814417 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 193/371] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:28 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:28.826037 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-465c7f5f-5b2f-4867-85cc-cdd27cbfa024 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:28.835721 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-465c7f5f-5b2f-4867-85cc-cdd27cbfa024 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.353857 May 12 14:34:28.837418 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 179/372] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:28 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:29.831707 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d586c1cc-fdbb-4de2-9c30-e847a5f0977a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:29.832977 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d586c1cc-fdbb-4de2-9c30-e847a5f0977a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:29.850527 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d586c1cc-fdbb-4de2-9c30-e847a5f0977a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:29.851259 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d586c1cc-fdbb-4de2-9c30-e847a5f0977a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:29.852055 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d586c1cc-fdbb-4de2-9c30-e847a5f0977a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:29.853284 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d586c1cc-fdbb-4de2-9c30-e847a5f0977a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:29.857576 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b9fdf5ff-8de1-423f-8667-a59865532ec1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:29.859620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b9fdf5ff-8de1-423f-8667-a59865532ec1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:29.872536 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9fdf5ff-8de1-423f-8667-a59865532ec1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:29.873354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9fdf5ff-8de1-423f-8667-a59865532ec1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:29.874385 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9fdf5ff-8de1-423f-8667-a59865532ec1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:29.876916 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9fdf5ff-8de1-423f-8667-a59865532ec1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:30.276141 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d586c1cc-fdbb-4de2-9c30-e847a5f0977a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:30.283790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d586c1cc-fdbb-4de2-9c30-e847a5f0977a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.456317 May 12 14:34:30.287618 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 194/373] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:29 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:30.473292 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b9fdf5ff-8de1-423f-8667-a59865532ec1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:30.482977 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b9fdf5ff-8de1-423f-8667-a59865532ec1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.633467 May 12 14:34:30.494040 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 180/374] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:29 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:31.303537 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-656dd7f3-e6a8-4b1e-86b5-43898f38a31b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:31.304329 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-656dd7f3-e6a8-4b1e-86b5-43898f38a31b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:31.311596 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-656dd7f3-e6a8-4b1e-86b5-43898f38a31b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:31.312069 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-656dd7f3-e6a8-4b1e-86b5-43898f38a31b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:31.312865 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-656dd7f3-e6a8-4b1e-86b5-43898f38a31b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:31.313319 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-656dd7f3-e6a8-4b1e-86b5-43898f38a31b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:31.514799 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c30c3a4d-4d99-4292-a18f-ec5a561105ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:31.516131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c30c3a4d-4d99-4292-a18f-ec5a561105ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:31.531703 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c30c3a4d-4d99-4292-a18f-ec5a561105ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:31.532402 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c30c3a4d-4d99-4292-a18f-ec5a561105ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:31.536063 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c30c3a4d-4d99-4292-a18f-ec5a561105ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:31.536514 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c30c3a4d-4d99-4292-a18f-ec5a561105ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:31.765589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-656dd7f3-e6a8-4b1e-86b5-43898f38a31b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:31.783527 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-656dd7f3-e6a8-4b1e-86b5-43898f38a31b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.483646 May 12 14:34:31.792638 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 195/375] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:31 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:31.792638 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-e52a8a48-06b8-4d83-99cf-846be06390ac req-2b8d93ad-e4f1-4ebb-869e-3adaf0a255f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53d1801-00ff-4886-8632-1d02c3275dd5", "name": "network-vif-plugged", "status": "completed", "tag": "e20769a6-986c-4bef-a558-db20551da4d2"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:31.803946 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-e52a8a48-06b8-4d83-99cf-846be06390ac req-2b8d93ad-e4f1-4ebb-869e-3adaf0a255f8 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:31.804392 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-e52a8a48-06b8-4d83-99cf-846be06390ac req-2b8d93ad-e4f1-4ebb-869e-3adaf0a255f8 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:31.825147 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-e52a8a48-06b8-4d83-99cf-846be06390ac req-2b8d93ad-e4f1-4ebb-869e-3adaf0a255f8 service nova] Creating event network-vif-plugged:e20769a6-986c-4bef-a558-db20551da4d2 for instance b53d1801-00ff-4886-8632-1d02c3275dd5 on hv-cinder-77703 May 12 14:34:31.838178 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-e52a8a48-06b8-4d83-99cf-846be06390ac req-2b8d93ad-e4f1-4ebb-869e-3adaf0a255f8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052718 May 12 14:34:31.841626 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 196/376] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:34:31.876678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c30c3a4d-4d99-4292-a18f-ec5a561105ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:31.884707 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c30c3a4d-4d99-4292-a18f-ec5a561105ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.388928 May 12 14:34:31.885286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 181/377] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:31 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:32.656063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a29ba387-8ad8-4474-9e4b-16fc54b6c265 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Action: 'create', calling method: .version_select at 0x7f5b27da19d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-273927603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyUEjZiaahHyPuBaO7u1SZWIjVA1AeryvDLAwkYIPXINK8H3e/0KLdVWRrphvx2AR7uyxyMY+snkS4GL8f0oW9j/u4maK3S+Uf9Uuz4PLf4stCTS3M15yc+JaKlxPAQfg=="}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:32.669550 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-a29ba387-8ad8-4474-9e4b-16fc54b6c265 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Getting quotas for project d9bb0671fa894da79848c7c46e553b5e. Resources: {'key_pairs'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:34:32.673418 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-a29ba387-8ad8-4474-9e4b-16fc54b6c265 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Getting quotas for user 4a65b858f4644a619a9c34cb99251efb and project d9bb0671fa894da79848c7c46e553b5e. Resources: {'key_pairs'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:34:32.684891 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a29ba387-8ad8-4474-9e4b-16fc54b6c265 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [558b9db4-be50-4601-a10d-fa3a317f2d2d] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 14:34:32.799542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-891bd450-9995-4871-9ae1-357872e25779 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:32.800153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-891bd450-9995-4871-9ae1-357872e25779 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:32.806513 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-891bd450-9995-4871-9ae1-357872e25779 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:32.806964 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-891bd450-9995-4871-9ae1-357872e25779 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:32.807800 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-891bd450-9995-4871-9ae1-357872e25779 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:32.808188 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-891bd450-9995-4871-9ae1-357872e25779 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:32.951609 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-891bd450-9995-4871-9ae1-357872e25779 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:32.958973 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-891bd450-9995-4871-9ae1-357872e25779 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.163372 May 12 14:34:32.959793 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 182/378] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:32 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:32.964724 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-405ac4e7-3e94-4065-9b65-4d9a60e22072 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:32.965572 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-405ac4e7-3e94-4065-9b65-4d9a60e22072 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:32.972916 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-405ac4e7-3e94-4065-9b65-4d9a60e22072 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:32.973379 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-405ac4e7-3e94-4065-9b65-4d9a60e22072 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:32.974174 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-405ac4e7-3e94-4065-9b65-4d9a60e22072 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:32.974620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-405ac4e7-3e94-4065-9b65-4d9a60e22072 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:33.120152 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-405ac4e7-3e94-4065-9b65-4d9a60e22072 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:33.128769 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-405ac4e7-3e94-4065-9b65-4d9a60e22072 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.167722 May 12 14:34:33.129524 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 183/379] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:32 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:33.692572 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO oslo.messaging._drivers.impl_rabbit [None req-a29ba387-8ad8-4474-9e4b-16fc54b6c265 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [558b9db4-be50-4601-a10d-fa3a317f2d2d] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 33776. May 12 14:34:33.707473 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a29ba387-8ad8-4474-9e4b-16fc54b6c265 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.234939 May 12 14:34:33.708072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 197/380] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 12 14:34:32 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:34:33.976748 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ac15e3aa-4934-4bcf-b6c6-88726faa92f5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:33.978321 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ac15e3aa-4934-4bcf-b6c6-88726faa92f5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:33.991052 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ac15e3aa-4934-4bcf-b6c6-88726faa92f5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:33.991052 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ac15e3aa-4934-4bcf-b6c6-88726faa92f5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:33.991052 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ac15e3aa-4934-4bcf-b6c6-88726faa92f5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:33.991052 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ac15e3aa-4934-4bcf-b6c6-88726faa92f5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:34.147131 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-01ff562e-fbe6-4149-9e3a-e030bf76715a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:34.148564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-01ff562e-fbe6-4149-9e3a-e030bf76715a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:34.158095 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-01ff562e-fbe6-4149-9e3a-e030bf76715a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:34.159146 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-01ff562e-fbe6-4149-9e3a-e030bf76715a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:34.160156 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-01ff562e-fbe6-4149-9e3a-e030bf76715a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:34.160808 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-01ff562e-fbe6-4149-9e3a-e030bf76715a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:34.175608 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ac15e3aa-4934-4bcf-b6c6-88726faa92f5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:34.185628 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ac15e3aa-4934-4bcf-b6c6-88726faa92f5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1266 microversion: 2.1 time: 0.213054 May 12 14:34:34.195601 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 184/381] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:33 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:34.441506 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b84096cd-8bbe-4ecb-bee4-e19308b6d568 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:34.442639 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b84096cd-8bbe-4ecb-bee4-e19308b6d568 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:34.450580 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-01ff562e-fbe6-4149-9e3a-e030bf76715a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:34.451117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b84096cd-8bbe-4ecb-bee4-e19308b6d568 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:34.451739 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b84096cd-8bbe-4ecb-bee4-e19308b6d568 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:34.452727 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b84096cd-8bbe-4ecb-bee4-e19308b6d568 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:34.453794 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b84096cd-8bbe-4ecb-bee4-e19308b6d568 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:34.462911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-01ff562e-fbe6-4149-9e3a-e030bf76715a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.320418 May 12 14:34:34.463671 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 198/382] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:34 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:34.485952 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b84096cd-8bbe-4ecb-bee4-e19308b6d568 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078/ips" status: 200 len: 149 microversion: 2.1 time: 0.049353 May 12 14:34:34.487099 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 185/383] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 12 14:34:34 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:34:35.203851 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d9c5fab8-6a23-459e-9eb8-35a1420c3fa8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:35.205192 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d9c5fab8-6a23-459e-9eb8-35a1420c3fa8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:35.211747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d9c5fab8-6a23-459e-9eb8-35a1420c3fa8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:35.212439 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d9c5fab8-6a23-459e-9eb8-35a1420c3fa8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:35.213630 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d9c5fab8-6a23-459e-9eb8-35a1420c3fa8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:35.214247 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d9c5fab8-6a23-459e-9eb8-35a1420c3fa8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:35.416544 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d9c5fab8-6a23-459e-9eb8-35a1420c3fa8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:35.425144 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d9c5fab8-6a23-459e-9eb8-35a1420c3fa8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1454 microversion: 2.1 time: 0.225785 May 12 14:34:35.438099 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 199/384] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:35 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1454 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:35.444869 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3ebca1b4-9e5e-489e-aa36-0e69f02f6981 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:35.446107 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3ebca1b4-9e5e-489e-aa36-0e69f02f6981 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:35.453992 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3ebca1b4-9e5e-489e-aa36-0e69f02f6981 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:35.454613 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3ebca1b4-9e5e-489e-aa36-0e69f02f6981 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:35.455611 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3ebca1b4-9e5e-489e-aa36-0e69f02f6981 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:35.456210 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3ebca1b4-9e5e-489e-aa36-0e69f02f6981 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:35.480671 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-481af1fa-4c61-4a91-aef0-8031553fa835 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:35.481387 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-481af1fa-4c61-4a91-aef0-8031553fa835 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:35.491913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-481af1fa-4c61-4a91-aef0-8031553fa835 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:35.492371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-481af1fa-4c61-4a91-aef0-8031553fa835 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:35.493165 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-481af1fa-4c61-4a91-aef0-8031553fa835 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:35.497454 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-481af1fa-4c61-4a91-aef0-8031553fa835 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:35.740929 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3ebca1b4-9e5e-489e-aa36-0e69f02f6981 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:35.751071 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3ebca1b4-9e5e-489e-aa36-0e69f02f6981 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1454 microversion: 2.1 time: 0.311518 May 12 14:34:35.766005 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 186/385] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:35 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1454 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:35.769622 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-481af1fa-4c61-4a91-aef0-8031553fa835 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:35.777627 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-481af1fa-4c61-4a91-aef0-8031553fa835 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.301527 May 12 14:34:35.778221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 200/386] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:35 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:36.795024 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e4b1720a-b11c-45a0-96bb-770e21408f44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:36.796699 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e4b1720a-b11c-45a0-96bb-770e21408f44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:36.812433 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e4b1720a-b11c-45a0-96bb-770e21408f44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:36.812907 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e4b1720a-b11c-45a0-96bb-770e21408f44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:36.813724 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e4b1720a-b11c-45a0-96bb-770e21408f44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:36.814164 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e4b1720a-b11c-45a0-96bb-770e21408f44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:37.033011 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e4b1720a-b11c-45a0-96bb-770e21408f44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:37.043686 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-925147af-6f5a-4d6f-8785-d402cd3376a9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97e190c3-d77e-4998-b3c6-42aad50a898c"}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:37.044641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e4b1720a-b11c-45a0-96bb-770e21408f44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.253374 May 12 14:34:37.044855 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-925147af-6f5a-4d6f-8785-d402cd3376a9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:37.045419 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 187/387] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:36 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:37.051595 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-925147af-6f5a-4d6f-8785-d402cd3376a9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:37.052272 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-925147af-6f5a-4d6f-8785-d402cd3376a9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:37.053217 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-925147af-6f5a-4d6f-8785-d402cd3376a9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:37.053813 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-925147af-6f5a-4d6f-8785-d402cd3376a9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:37.408670 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-925147af-6f5a-4d6f-8785-d402cd3376a9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "POST /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368937 May 12 14:34:37.411066 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 201/388] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 12 14:34:37 2022] POST /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:34:37.997531 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-e5b40ad6-52cb-4d16-8f0d-39344c616e8d req-f1d45f8b-c330-43b9-8160-5372ed84d10d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b53d1801-00ff-4886-8632-1d02c3275dd5", "tag": "e20769a6-986c-4bef-a558-db20551da4d2"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:38.008625 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-e5b40ad6-52cb-4d16-8f0d-39344c616e8d req-f1d45f8b-c330-43b9-8160-5372ed84d10d service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:38.009175 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-e5b40ad6-52cb-4d16-8f0d-39344c616e8d req-f1d45f8b-c330-43b9-8160-5372ed84d10d service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:38.021601 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-e5b40ad6-52cb-4d16-8f0d-39344c616e8d req-f1d45f8b-c330-43b9-8160-5372ed84d10d service nova] Creating event network-changed:e20769a6-986c-4bef-a558-db20551da4d2 for instance b53d1801-00ff-4886-8632-1d02c3275dd5 on hv-cinder-77703 May 12 14:34:38.026622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-e5b40ad6-52cb-4d16-8f0d-39344c616e8d req-f1d45f8b-c330-43b9-8160-5372ed84d10d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036648 May 12 14:34:38.028458 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 188/389] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:34:38.066006 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9383bb0a-6ad7-46fc-9ca7-aa384e5509dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:38.066706 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9383bb0a-6ad7-46fc-9ca7-aa384e5509dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:38.073904 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9383bb0a-6ad7-46fc-9ca7-aa384e5509dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:38.074283 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9383bb0a-6ad7-46fc-9ca7-aa384e5509dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:38.075085 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9383bb0a-6ad7-46fc-9ca7-aa384e5509dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:38.075891 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9383bb0a-6ad7-46fc-9ca7-aa384e5509dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:38.293256 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9383bb0a-6ad7-46fc-9ca7-aa384e5509dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:38.301639 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9383bb0a-6ad7-46fc-9ca7-aa384e5509dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.241441 May 12 14:34:38.302669 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 202/390] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:38 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:39.319730 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f1ca80c3-0ad3-41b4-ab19-ae8af3cec9fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:39.320442 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f1ca80c3-0ad3-41b4-ab19-ae8af3cec9fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:39.326532 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f1ca80c3-0ad3-41b4-ab19-ae8af3cec9fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:39.326992 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f1ca80c3-0ad3-41b4-ab19-ae8af3cec9fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:39.330339 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f1ca80c3-0ad3-41b4-ab19-ae8af3cec9fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:39.330805 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f1ca80c3-0ad3-41b4-ab19-ae8af3cec9fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:39.467524 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f1ca80c3-0ad3-41b4-ab19-ae8af3cec9fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:39.477014 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f1ca80c3-0ad3-41b4-ab19-ae8af3cec9fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.162074 May 12 14:34:39.477594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 189/391] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:39 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:40.494427 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0d76834e-ed0a-4702-b838-309a91bf2568 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:40.495057 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0d76834e-ed0a-4702-b838-309a91bf2568 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:40.501401 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0d76834e-ed0a-4702-b838-309a91bf2568 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:40.501854 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0d76834e-ed0a-4702-b838-309a91bf2568 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:40.502893 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0d76834e-ed0a-4702-b838-309a91bf2568 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:40.503369 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0d76834e-ed0a-4702-b838-309a91bf2568 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:40.636081 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0d76834e-ed0a-4702-b838-309a91bf2568 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:40.643768 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0d76834e-ed0a-4702-b838-309a91bf2568 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.153195 May 12 14:34:40.644328 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 203/392] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:40 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:41.660808 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4bef4f06-2637-448c-acc9-ad9cb97c716d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:41.661568 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4bef4f06-2637-448c-acc9-ad9cb97c716d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:41.667822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bef4f06-2637-448c-acc9-ad9cb97c716d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:41.668278 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bef4f06-2637-448c-acc9-ad9cb97c716d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:41.669048 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bef4f06-2637-448c-acc9-ad9cb97c716d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:41.669486 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bef4f06-2637-448c-acc9-ad9cb97c716d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:41.803864 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4bef4f06-2637-448c-acc9-ad9cb97c716d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:41.811159 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4bef4f06-2637-448c-acc9-ad9cb97c716d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.154662 May 12 14:34:41.811739 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 190/393] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:41 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:42.811314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-646c59be-23b6-45e3-a31b-39a1c3e7f6c7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:42.811823 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-646c59be-23b6-45e3-a31b-39a1c3e7f6c7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:42.818596 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-646c59be-23b6-45e3-a31b-39a1c3e7f6c7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:42.819071 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-646c59be-23b6-45e3-a31b-39a1c3e7f6c7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:42.819839 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-646c59be-23b6-45e3-a31b-39a1c3e7f6c7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:42.820274 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-646c59be-23b6-45e3-a31b-39a1c3e7f6c7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:42.828267 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4bf7d360-cff5-409e-a06f-63a5024888cc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:42.829149 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4bf7d360-cff5-409e-a06f-63a5024888cc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:42.836598 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bf7d360-cff5-409e-a06f-63a5024888cc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:42.836598 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bf7d360-cff5-409e-a06f-63a5024888cc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:42.836866 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bf7d360-cff5-409e-a06f-63a5024888cc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:42.837142 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4bf7d360-cff5-409e-a06f-63a5024888cc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:42.845071 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-646c59be-23b6-45e3-a31b-39a1c3e7f6c7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/ips" status: 200 len: 152 microversion: 2.20 time: 0.037656 May 12 14:34:42.845952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 204/394] 10.222.0.75 () {60 vars in 1288 bytes} [Thu May 12 14:34:42 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:34:42.995579 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4bf7d360-cff5-409e-a06f-63a5024888cc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:43.004179 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4bf7d360-cff5-409e-a06f-63a5024888cc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.180340 May 12 14:34:43.004791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 191/395] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:42 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:44.022170 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-eda9c3e2-72a5-4ab6-940b-8fa46d4b588c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:44.022790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-eda9c3e2-72a5-4ab6-940b-8fa46d4b588c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:44.029126 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eda9c3e2-72a5-4ab6-940b-8fa46d4b588c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:44.029585 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eda9c3e2-72a5-4ab6-940b-8fa46d4b588c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:44.030361 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eda9c3e2-72a5-4ab6-940b-8fa46d4b588c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:44.030803 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eda9c3e2-72a5-4ab6-940b-8fa46d4b588c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:44.162844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-eda9c3e2-72a5-4ab6-940b-8fa46d4b588c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:44.170919 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-eda9c3e2-72a5-4ab6-940b-8fa46d4b588c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.152518 May 12 14:34:44.171551 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 205/396] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:44 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:45.188421 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-22877e5e-cbd4-44de-a7fb-5bb4468a3c12 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:45.188907 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-22877e5e-cbd4-44de-a7fb-5bb4468a3c12 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:45.195480 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-22877e5e-cbd4-44de-a7fb-5bb4468a3c12 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:45.196078 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-22877e5e-cbd4-44de-a7fb-5bb4468a3c12 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:45.196932 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-22877e5e-cbd4-44de-a7fb-5bb4468a3c12 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:45.197373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-22877e5e-cbd4-44de-a7fb-5bb4468a3c12 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:45.334654 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-22877e5e-cbd4-44de-a7fb-5bb4468a3c12 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:45.341840 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-22877e5e-cbd4-44de-a7fb-5bb4468a3c12 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.157489 May 12 14:34:45.342411 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 192/397] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:45 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:45.955091 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-82ab1fb3-d0e3-4a4d-a587-12d451ba0ac2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Action: 'create', calling method: .version_select at 0x7f5b262f3790>, body: {"keypair": {"name": "tempest-keypair-173808100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqE1qYVaUhKIcqsdAXXxFPRTLHJ1EJzzjWQ8ReEPPK+PE81GrDNy/3KTVAQj+R6XZmkuDvQmugP+cLIoG8zd+K2QJXAkQ/vp/myIMGcr1T0RwWUyWOZ3ObYFoizO4rN0g=="}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:45.970054 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-82ab1fb3-d0e3-4a4d-a587-12d451ba0ac2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for project e4b5ca018b5f4dda99486407424b8168. Resources: {'key_pairs'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:34:45.973959 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-82ab1fb3-d0e3-4a4d-a587-12d451ba0ac2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for user c6422873a3b84aac88f8a93291bcd7b0 and project e4b5ca018b5f4dda99486407424b8168. Resources: {'key_pairs'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:34:45.995092 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-82ab1fb3-d0e3-4a4d-a587-12d451ba0ac2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043865 May 12 14:34:45.995869 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 206/398] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 12 14:34:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:34:46.358036 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9be7af05-4424-46ea-8b16-5999f8dd2dab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:46.358985 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9be7af05-4424-46ea-8b16-5999f8dd2dab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:46.366212 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9be7af05-4424-46ea-8b16-5999f8dd2dab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:46.366666 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9be7af05-4424-46ea-8b16-5999f8dd2dab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:46.367479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9be7af05-4424-46ea-8b16-5999f8dd2dab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:46.367922 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9be7af05-4424-46ea-8b16-5999f8dd2dab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:46.499573 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9be7af05-4424-46ea-8b16-5999f8dd2dab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:46.507157 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9be7af05-4424-46ea-8b16-5999f8dd2dab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.153048 May 12 14:34:46.507740 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 193/399] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:46 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:47.018130 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-00f89efb-a2d4-4ef3-b775-4404575b2938 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:47.018770 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-00f89efb-a2d4-4ef3-b775-4404575b2938 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:47.025046 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-00f89efb-a2d4-4ef3-b775-4404575b2938 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:47.025506 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-00f89efb-a2d4-4ef3-b775-4404575b2938 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:47.026316 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-00f89efb-a2d4-4ef3-b775-4404575b2938 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:47.026763 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-00f89efb-a2d4-4ef3-b775-4404575b2938 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:47.051934 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-00f89efb-a2d4-4ef3-b775-4404575b2938 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lazy-loading 'flavor' on Instance uuid d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:34:47.163599 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e8909300-1d05-4bc0-a389-530710683a97 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad170dd9-54b6-4e19-b976-7fbe22a0ee2a", "device": "/dev/sdb"}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:47.165747 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e8909300-1d05-4bc0-a389-530710683a97 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:47.171822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e8909300-1d05-4bc0-a389-530710683a97 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:47.172888 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e8909300-1d05-4bc0-a389-530710683a97 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:47.174307 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e8909300-1d05-4bc0-a389-530710683a97 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:47.174790 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e8909300-1d05-4bc0-a389-530710683a97 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:47.393290 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-00f89efb-a2d4-4ef3-b775-4404575b2938 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "POST /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/action" status: 202 len: 0 microversion: 2.20 time: 0.380172 May 12 14:34:47.393929 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 207/400] 10.222.0.75 () {62 vars in 1318 bytes} [Thu May 12 14:34:47 2022] POST /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:34:47.404569 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-26019fc1-e1a5-4542-9969-6b8d73881d7d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:47.405859 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-26019fc1-e1a5-4542-9969-6b8d73881d7d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:47.415823 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-26019fc1-e1a5-4542-9969-6b8d73881d7d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:47.416277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-26019fc1-e1a5-4542-9969-6b8d73881d7d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:47.417223 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-26019fc1-e1a5-4542-9969-6b8d73881d7d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:47.417725 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-26019fc1-e1a5-4542-9969-6b8d73881d7d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:47.494535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e8909300-1d05-4bc0-a389-530710683a97 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "POST /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334822 May 12 14:34:47.495876 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 194/401] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 12 14:34:47 2022] POST /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:34:47.525290 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-31a5f7b1-97d7-484b-b14d-2b38fb48548d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:47.526416 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-31a5f7b1-97d7-484b-b14d-2b38fb48548d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:47.533656 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-31a5f7b1-97d7-484b-b14d-2b38fb48548d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:47.534118 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-31a5f7b1-97d7-484b-b14d-2b38fb48548d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:47.535051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-31a5f7b1-97d7-484b-b14d-2b38fb48548d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:47.535871 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-31a5f7b1-97d7-484b-b14d-2b38fb48548d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:47.590756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-26019fc1-e1a5-4542-9969-6b8d73881d7d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:47.599238 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-26019fc1-e1a5-4542-9969-6b8d73881d7d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:47.600750 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-26019fc1-e1a5-4542-9969-6b8d73881d7d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:47.601982 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-26019fc1-e1a5-4542-9969-6b8d73881d7d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.203708 May 12 14:34:47.602564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 208/402] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:34:47 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:34:47.613572 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-835829999", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fdc0b19-4053-4c44-8b08-cd1ab3959461"}], "security_groups": [{"name": "tempest-securitygroup--656090517"}], "key_name": "tempest-keypair-173808100", "user_data": "}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:47.714247 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-31a5f7b1-97d7-484b-b14d-2b38fb48548d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:47.722298 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-31a5f7b1-97d7-484b-b14d-2b38fb48548d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.201664 May 12 14:34:47.722879 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 195/403] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:47 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:47.726706 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.network.neutron [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] validate_networks() for [('3fdc0b19-4053-4c44-8b08-cd1ab3959461', None, None, None, None, None)] {{(pid=118216) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:34:48.098240 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Flavor limits 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:34:48.098805 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Image limits 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:34:48.099163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Flavor pref 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:34:48.099574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Image pref 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:34:48.099986 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:34:48.108703 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:48.109149 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:48.110107 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:48.110542 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:48.126645 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for project e4b5ca018b5f4dda99486407424b8168. Resources: {'cores', 'instances', 'ram'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:34:48.130886 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for user c6422873a3b84aac88f8a93291bcd7b0 and project e4b5ca018b5f4dda99486407424b8168. Resources: {'cores', 'instances', 'ram'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:34:48.142989 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Going to run 1 instances... {{(pid=118216) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:34:48.145299 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:34:48.191343 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4c8334c9-447e-4e04-8b6c-aeced80b4303 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.587612 May 12 14:34:48.191986 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 209/404] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:34:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:34:48.204112 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f6582f2c-58da-41cd-b6d6-918a89fb4978 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:48.205168 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f6582f2c-58da-41cd-b6d6-918a89fb4978 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:48.279467 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f6582f2c-58da-41cd-b6d6-918a89fb4978 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:48.286666 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f6582f2c-58da-41cd-b6d6-918a89fb4978 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1240 microversion: 2.1 time: 0.087870 May 12 14:34:48.287299 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 196/405] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:48 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:48.621059 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-263c738c-024d-4870-9685-b38a58058145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:48.621693 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-263c738c-024d-4870-9685-b38a58058145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:48.627888 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-263c738c-024d-4870-9685-b38a58058145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:48.628329 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-263c738c-024d-4870-9685-b38a58058145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:48.629084 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-263c738c-024d-4870-9685-b38a58058145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:48.629528 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-263c738c-024d-4870-9685-b38a58058145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:48.739313 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-04b1de03-64cf-45dc-9274-1dfbd274a271 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:48.739962 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-04b1de03-64cf-45dc-9274-1dfbd274a271 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:48.750321 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-04b1de03-64cf-45dc-9274-1dfbd274a271 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:48.750783 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-04b1de03-64cf-45dc-9274-1dfbd274a271 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:48.751662 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-04b1de03-64cf-45dc-9274-1dfbd274a271 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:48.752405 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-04b1de03-64cf-45dc-9274-1dfbd274a271 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:48.759779 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-263c738c-024d-4870-9685-b38a58058145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:48.768342 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-263c738c-024d-4870-9685-b38a58058145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:48.769938 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-263c738c-024d-4870-9685-b38a58058145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:48.771215 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-263c738c-024d-4870-9685-b38a58058145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.154055 May 12 14:34:48.771869 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 210/406] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:34:48 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:34:48.884859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-04b1de03-64cf-45dc-9274-1dfbd274a271 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:48.892717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-04b1de03-64cf-45dc-9274-1dfbd274a271 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.157365 May 12 14:34:48.893283 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 197/407] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:48 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:49.303955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e5e62676-1ab7-4ae8-b001-8bf1c9f7f9cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:49.304573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e5e62676-1ab7-4ae8-b001-8bf1c9f7f9cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:49.311133 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e5e62676-1ab7-4ae8-b001-8bf1c9f7f9cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:49.311533 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e5e62676-1ab7-4ae8-b001-8bf1c9f7f9cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:49.312319 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e5e62676-1ab7-4ae8-b001-8bf1c9f7f9cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:49.312784 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e5e62676-1ab7-4ae8-b001-8bf1c9f7f9cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:49.374087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e5e62676-1ab7-4ae8-b001-8bf1c9f7f9cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:49.381779 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e5e62676-1ab7-4ae8-b001-8bf1c9f7f9cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1244 microversion: 2.1 time: 0.081628 May 12 14:34:49.382364 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 211/408] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:49 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:49.789728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bdbb2bf2-72ce-4bcb-876a-42b95d72d97b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:49.790341 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bdbb2bf2-72ce-4bcb-876a-42b95d72d97b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:49.796631 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bdbb2bf2-72ce-4bcb-876a-42b95d72d97b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:49.797738 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bdbb2bf2-72ce-4bcb-876a-42b95d72d97b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:49.798514 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bdbb2bf2-72ce-4bcb-876a-42b95d72d97b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:49.798957 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bdbb2bf2-72ce-4bcb-876a-42b95d72d97b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:49.910047 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-cd3087f0-e8f0-4fd4-9c36-0d184390962c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:49.910752 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-cd3087f0-e8f0-4fd4-9c36-0d184390962c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:49.916916 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cd3087f0-e8f0-4fd4-9c36-0d184390962c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:49.917366 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cd3087f0-e8f0-4fd4-9c36-0d184390962c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:49.918208 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cd3087f0-e8f0-4fd4-9c36-0d184390962c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:49.918647 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cd3087f0-e8f0-4fd4-9c36-0d184390962c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:49.945633 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bdbb2bf2-72ce-4bcb-876a-42b95d72d97b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:49.953993 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bdbb2bf2-72ce-4bcb-876a-42b95d72d97b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:49.955537 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bdbb2bf2-72ce-4bcb-876a-42b95d72d97b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:49.956701 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bdbb2bf2-72ce-4bcb-876a-42b95d72d97b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.170958 May 12 14:34:49.957270 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 198/409] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:34:49 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:34:50.047433 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-cd3087f0-e8f0-4fd4-9c36-0d184390962c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:50.054643 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-cd3087f0-e8f0-4fd4-9c36-0d184390962c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.149206 May 12 14:34:50.055242 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 212/410] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:49 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:50.398376 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5b775445-60bd-4032-8e11-cf6b2623eaa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:50.398998 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5b775445-60bd-4032-8e11-cf6b2623eaa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:50.405170 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5b775445-60bd-4032-8e11-cf6b2623eaa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:50.405629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5b775445-60bd-4032-8e11-cf6b2623eaa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:50.406412 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5b775445-60bd-4032-8e11-cf6b2623eaa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:50.406854 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5b775445-60bd-4032-8e11-cf6b2623eaa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:50.469203 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5b775445-60bd-4032-8e11-cf6b2623eaa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:50.476442 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5b775445-60bd-4032-8e11-cf6b2623eaa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1244 microversion: 2.1 time: 0.081957 May 12 14:34:50.477013 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 199/411] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:50 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:50.977948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3feaa1c3-1288-4029-9197-6d73939dd865 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:50.978557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3feaa1c3-1288-4029-9197-6d73939dd865 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:50.984874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3feaa1c3-1288-4029-9197-6d73939dd865 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:50.985318 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3feaa1c3-1288-4029-9197-6d73939dd865 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:50.986116 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3feaa1c3-1288-4029-9197-6d73939dd865 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:50.986653 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3feaa1c3-1288-4029-9197-6d73939dd865 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:51.071415 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c444379e-8e42-4f19-b985-a198601443d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:51.072048 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c444379e-8e42-4f19-b985-a198601443d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:51.080151 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c444379e-8e42-4f19-b985-a198601443d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:51.080619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c444379e-8e42-4f19-b985-a198601443d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:51.083866 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c444379e-8e42-4f19-b985-a198601443d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:51.084326 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c444379e-8e42-4f19-b985-a198601443d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:51.163134 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3feaa1c3-1288-4029-9197-6d73939dd865 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:51.171938 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3feaa1c3-1288-4029-9197-6d73939dd865 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:51.173500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3feaa1c3-1288-4029-9197-6d73939dd865 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:51.174699 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3feaa1c3-1288-4029-9197-6d73939dd865 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.200767 May 12 14:34:51.175314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 213/412] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:34:50 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:34:51.231700 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c444379e-8e42-4f19-b985-a198601443d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:51.239155 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c444379e-8e42-4f19-b985-a198601443d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.171570 May 12 14:34:51.239884 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 200/413] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:51 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:51.493721 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9c958874-bece-4dcc-887b-8a0171345634 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:51.494444 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9c958874-bece-4dcc-887b-8a0171345634 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:51.502777 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9c958874-bece-4dcc-887b-8a0171345634 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:51.503540 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9c958874-bece-4dcc-887b-8a0171345634 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:51.504037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9c958874-bece-4dcc-887b-8a0171345634 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:51.504615 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9c958874-bece-4dcc-887b-8a0171345634 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:51.571235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9c958874-bece-4dcc-887b-8a0171345634 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:51.579290 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9c958874-bece-4dcc-887b-8a0171345634 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1236 microversion: 2.1 time: 0.089408 May 12 14:34:51.579862 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 214/414] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:51 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1236 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:52.192342 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0f94e49d-c4f3-494f-8972-412fb7298d99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:52.192961 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0f94e49d-c4f3-494f-8972-412fb7298d99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:52.199505 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0f94e49d-c4f3-494f-8972-412fb7298d99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:52.199986 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0f94e49d-c4f3-494f-8972-412fb7298d99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:52.200804 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0f94e49d-c4f3-494f-8972-412fb7298d99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:52.201250 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0f94e49d-c4f3-494f-8972-412fb7298d99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:52.256375 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-5a567f17-2d2d-4f11-ae77-3ac5a0fb2117 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:52.257093 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-5a567f17-2d2d-4f11-ae77-3ac5a0fb2117 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:52.263528 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5a567f17-2d2d-4f11-ae77-3ac5a0fb2117 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:52.264076 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5a567f17-2d2d-4f11-ae77-3ac5a0fb2117 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:52.264933 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5a567f17-2d2d-4f11-ae77-3ac5a0fb2117 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:52.265453 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5a567f17-2d2d-4f11-ae77-3ac5a0fb2117 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:52.375759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0f94e49d-c4f3-494f-8972-412fb7298d99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:52.383952 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0f94e49d-c4f3-494f-8972-412fb7298d99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:52.385452 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0f94e49d-c4f3-494f-8972-412fb7298d99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:52.386650 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0f94e49d-c4f3-494f-8972-412fb7298d99 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.198195 May 12 14:34:52.387234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 201/415] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:34:52 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:34:52.425724 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-5a567f17-2d2d-4f11-ae77-3ac5a0fb2117 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:52.433361 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-5a567f17-2d2d-4f11-ae77-3ac5a0fb2117 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.181029 May 12 14:34:52.433946 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 215/416] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:52 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:52.597790 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3bc9142e-8feb-4ff1-bd9e-0b4c2d2530cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:52.598412 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3bc9142e-8feb-4ff1-bd9e-0b4c2d2530cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:52.604465 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3bc9142e-8feb-4ff1-bd9e-0b4c2d2530cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:52.604924 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3bc9142e-8feb-4ff1-bd9e-0b4c2d2530cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:52.605713 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3bc9142e-8feb-4ff1-bd9e-0b4c2d2530cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:52.606157 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3bc9142e-8feb-4ff1-bd9e-0b4c2d2530cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:52.668733 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3bc9142e-8feb-4ff1-bd9e-0b4c2d2530cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:52.676551 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3bc9142e-8feb-4ff1-bd9e-0b4c2d2530cc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1292 microversion: 2.1 time: 0.082768 May 12 14:34:52.677116 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 202/417] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:52 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:53.404958 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-95bc118a-de9d-403b-b44a-7af9b9173cc5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:53.405564 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-95bc118a-de9d-403b-b44a-7af9b9173cc5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:53.412487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-95bc118a-de9d-403b-b44a-7af9b9173cc5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:53.412932 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-95bc118a-de9d-403b-b44a-7af9b9173cc5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:53.413695 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-95bc118a-de9d-403b-b44a-7af9b9173cc5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:53.414126 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-95bc118a-de9d-403b-b44a-7af9b9173cc5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:53.450651 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-10549000-81f4-42b9-9d19-fa7b57dfbb2b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:53.451527 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-10549000-81f4-42b9-9d19-fa7b57dfbb2b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:53.458907 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-10549000-81f4-42b9-9d19-fa7b57dfbb2b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:53.459412 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-10549000-81f4-42b9-9d19-fa7b57dfbb2b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:53.460214 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-10549000-81f4-42b9-9d19-fa7b57dfbb2b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:53.460661 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-10549000-81f4-42b9-9d19-fa7b57dfbb2b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:53.602864 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-95bc118a-de9d-403b-b44a-7af9b9173cc5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:53.609839 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-95bc118a-de9d-403b-b44a-7af9b9173cc5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:53.611399 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-95bc118a-de9d-403b-b44a-7af9b9173cc5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:53.612695 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-95bc118a-de9d-403b-b44a-7af9b9173cc5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.211698 May 12 14:34:53.613361 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 216/418] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:34:53 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:34:53.628851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-10549000-81f4-42b9-9d19-fa7b57dfbb2b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:53.636420 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-10549000-81f4-42b9-9d19-fa7b57dfbb2b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1522 microversion: 2.1 time: 0.189603 May 12 14:34:53.637003 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 203/419] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:53 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:53.692925 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1dcbaa1f-cfd2-4fb2-a3c7-e2be75f6f90c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:53.693908 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1dcbaa1f-cfd2-4fb2-a3c7-e2be75f6f90c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:53.699776 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1dcbaa1f-cfd2-4fb2-a3c7-e2be75f6f90c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:53.700420 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1dcbaa1f-cfd2-4fb2-a3c7-e2be75f6f90c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:53.701191 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1dcbaa1f-cfd2-4fb2-a3c7-e2be75f6f90c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:53.701816 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1dcbaa1f-cfd2-4fb2-a3c7-e2be75f6f90c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:53.765060 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1dcbaa1f-cfd2-4fb2-a3c7-e2be75f6f90c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:53.773160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1dcbaa1f-cfd2-4fb2-a3c7-e2be75f6f90c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1292 microversion: 2.1 time: 0.084591 May 12 14:34:53.773757 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 217/420] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:53 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:54.630151 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f5891cb2-a914-4d53-8de8-d8f2c8c41d25 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:54.631372 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f5891cb2-a914-4d53-8de8-d8f2c8c41d25 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:54.637674 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f5891cb2-a914-4d53-8de8-d8f2c8c41d25 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:54.638403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f5891cb2-a914-4d53-8de8-d8f2c8c41d25 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:54.639350 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f5891cb2-a914-4d53-8de8-d8f2c8c41d25 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:54.639796 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f5891cb2-a914-4d53-8de8-d8f2c8c41d25 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:54.654321 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-01a158a5-3eca-44ac-9317-e264b6eb90da tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:54.656308 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-01a158a5-3eca-44ac-9317-e264b6eb90da tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:54.663571 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-01a158a5-3eca-44ac-9317-e264b6eb90da tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:54.664033 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-01a158a5-3eca-44ac-9317-e264b6eb90da tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:54.664826 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-01a158a5-3eca-44ac-9317-e264b6eb90da tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:54.665271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-01a158a5-3eca-44ac-9317-e264b6eb90da tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:54.869255 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f5891cb2-a914-4d53-8de8-d8f2c8c41d25 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:54.878246 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f5891cb2-a914-4d53-8de8-d8f2c8c41d25 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:54.879301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f5891cb2-a914-4d53-8de8-d8f2c8c41d25 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:54.880465 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f5891cb2-a914-4d53-8de8-d8f2c8c41d25 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.254673 May 12 14:34:54.881323 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 204/421] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:34:54 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:34:54.885715 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5a95d0ab-7cfc-4b9f-beb5-104c7804db4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:54.886526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5a95d0ab-7cfc-4b9f-beb5-104c7804db4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:54.892981 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5a95d0ab-7cfc-4b9f-beb5-104c7804db4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:54.893496 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5a95d0ab-7cfc-4b9f-beb5-104c7804db4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:54.894473 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5a95d0ab-7cfc-4b9f-beb5-104c7804db4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:54.894914 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5a95d0ab-7cfc-4b9f-beb5-104c7804db4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:54.895695 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-01a158a5-3eca-44ac-9317-e264b6eb90da tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:54.903297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-01a158a5-3eca-44ac-9317-e264b6eb90da tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1502 microversion: 2.1 time: 0.253351 May 12 14:34:54.915165 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 218/422] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:54 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1502 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:54.920150 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4d9f415b-ccd4-42a2-bb28-27aeb03692f2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:54.921143 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4d9f415b-ccd4-42a2-bb28-27aeb03692f2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:54.932512 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4d9f415b-ccd4-42a2-bb28-27aeb03692f2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:54.933146 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4d9f415b-ccd4-42a2-bb28-27aeb03692f2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:54.936064 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4d9f415b-ccd4-42a2-bb28-27aeb03692f2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:54.936729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4d9f415b-ccd4-42a2-bb28-27aeb03692f2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:54.988158 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5a95d0ab-7cfc-4b9f-beb5-104c7804db4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:54.995420 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5a95d0ab-7cfc-4b9f-beb5-104c7804db4a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1298 microversion: 2.1 time: 0.113074 May 12 14:34:54.996004 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 205/423] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:54 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:55.121633 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4d9f415b-ccd4-42a2-bb28-27aeb03692f2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:55.129990 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4d9f415b-ccd4-42a2-bb28-27aeb03692f2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1517 microversion: 2.1 time: 0.213476 May 12 14:34:55.130572 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 219/424] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:54 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1517 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:55.900256 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-fc4732e7-791f-4d54-b9a9-8f6ab1bd4233 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:55.900984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-fc4732e7-791f-4d54-b9a9-8f6ab1bd4233 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:55.907527 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fc4732e7-791f-4d54-b9a9-8f6ab1bd4233 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:55.908065 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fc4732e7-791f-4d54-b9a9-8f6ab1bd4233 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:55.909594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fc4732e7-791f-4d54-b9a9-8f6ab1bd4233 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:55.910106 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fc4732e7-791f-4d54-b9a9-8f6ab1bd4233 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:56.012719 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8d67cadc-8412-45f7-8ee7-25f47a75b13e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:56.013237 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-8d67cadc-8412-45f7-8ee7-25f47a75b13e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:56.020427 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8d67cadc-8412-45f7-8ee7-25f47a75b13e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:56.020881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8d67cadc-8412-45f7-8ee7-25f47a75b13e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:56.021668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8d67cadc-8412-45f7-8ee7-25f47a75b13e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:56.022102 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8d67cadc-8412-45f7-8ee7-25f47a75b13e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:56.145477 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-fc4732e7-791f-4d54-b9a9-8f6ab1bd4233 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:56.153694 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-fc4732e7-791f-4d54-b9a9-8f6ab1bd4233 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:56.155470 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-fc4732e7-791f-4d54-b9a9-8f6ab1bd4233 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:56.156838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-fc4732e7-791f-4d54-b9a9-8f6ab1bd4233 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.260713 May 12 14:34:56.157396 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 206/425] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:34:55 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:34:56.244714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8d67cadc-8412-45f7-8ee7-25f47a75b13e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:56.253869 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8d67cadc-8412-45f7-8ee7-25f47a75b13e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.245050 May 12 14:34:56.254450 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 220/426] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:56 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:56.299783 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-52e827ea-c79e-4fe6-8f48-6e667ceac577 req-34ad83fd-05ef-4e76-b054-4c066300773a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a95d03a-223b-49bc-ba3a-afc4119c02c1", "tag": "f024020e-bf8c-4cf9-8ca2-23128204e9b2"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:56.308088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-52e827ea-c79e-4fe6-8f48-6e667ceac577 req-34ad83fd-05ef-4e76-b054-4c066300773a service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:56.308542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-52e827ea-c79e-4fe6-8f48-6e667ceac577 req-34ad83fd-05ef-4e76-b054-4c066300773a service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:56.320085 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-52e827ea-c79e-4fe6-8f48-6e667ceac577 req-34ad83fd-05ef-4e76-b054-4c066300773a service nova] Creating event network-changed:f024020e-bf8c-4cf9-8ca2-23128204e9b2 for instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 on hv-cinder-77703 May 12 14:34:56.325514 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-52e827ea-c79e-4fe6-8f48-6e667ceac577 req-34ad83fd-05ef-4e76-b054-4c066300773a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030485 May 12 14:34:56.326215 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 207/427] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:34:57.176338 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e9b93843-d0c7-456c-903b-103669e33fed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:57.176960 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e9b93843-d0c7-456c-903b-103669e33fed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:57.182992 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e9b93843-d0c7-456c-903b-103669e33fed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:57.183477 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e9b93843-d0c7-456c-903b-103669e33fed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:57.184261 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e9b93843-d0c7-456c-903b-103669e33fed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:57.184743 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e9b93843-d0c7-456c-903b-103669e33fed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:57.272769 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3e203003-0e3a-4d38-b184-7481ee42d3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:57.273730 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3e203003-0e3a-4d38-b184-7481ee42d3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:57.280848 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e203003-0e3a-4d38-b184-7481ee42d3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:57.281233 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e203003-0e3a-4d38-b184-7481ee42d3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:57.282005 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e203003-0e3a-4d38-b184-7481ee42d3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:57.282468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e203003-0e3a-4d38-b184-7481ee42d3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:57.331325 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e9b93843-d0c7-456c-903b-103669e33fed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:57.338958 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e9b93843-d0c7-456c-903b-103669e33fed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:57.340500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e9b93843-d0c7-456c-903b-103669e33fed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:57.341669 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e9b93843-d0c7-456c-903b-103669e33fed tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.170314 May 12 14:34:57.342239 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 221/428] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:34:57 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:34:57.413628 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3e203003-0e3a-4d38-b184-7481ee42d3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:57.420810 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3e203003-0e3a-4d38-b184-7481ee42d3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.153842 May 12 14:34:57.421382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 208/429] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:57 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:58.360467 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-de4c68c3-8e92-4219-b7d8-03dd2ee4e221 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:58.361000 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-de4c68c3-8e92-4219-b7d8-03dd2ee4e221 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:58.367453 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-de4c68c3-8e92-4219-b7d8-03dd2ee4e221 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:58.367910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-de4c68c3-8e92-4219-b7d8-03dd2ee4e221 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:58.368680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-de4c68c3-8e92-4219-b7d8-03dd2ee4e221 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:58.369120 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-de4c68c3-8e92-4219-b7d8-03dd2ee4e221 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:58.437868 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f3d8d33d-fc03-483a-9314-b2f8ea40dbf7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:58.438493 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f3d8d33d-fc03-483a-9314-b2f8ea40dbf7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:58.445731 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f3d8d33d-fc03-483a-9314-b2f8ea40dbf7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:58.446274 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f3d8d33d-fc03-483a-9314-b2f8ea40dbf7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:58.446973 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f3d8d33d-fc03-483a-9314-b2f8ea40dbf7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:58.447462 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f3d8d33d-fc03-483a-9314-b2f8ea40dbf7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:58.789973 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-de4c68c3-8e92-4219-b7d8-03dd2ee4e221 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:58.797654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-de4c68c3-8e92-4219-b7d8-03dd2ee4e221 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:58.799746 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-de4c68c3-8e92-4219-b7d8-03dd2ee4e221 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:58.800900 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-de4c68c3-8e92-4219-b7d8-03dd2ee4e221 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.444432 May 12 14:34:58.801032 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f3d8d33d-fc03-483a-9314-b2f8ea40dbf7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:58.801714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 222/430] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:34:58 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:34:58.806507 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d411c09e-cfb8-408a-b60e-ee7626259910 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:34:58.807542 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d411c09e-cfb8-408a-b60e-ee7626259910 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:58.808354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f3d8d33d-fc03-483a-9314-b2f8ea40dbf7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.374409 May 12 14:34:58.809197 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 209/431] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:58 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:34:58.818522 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d411c09e-cfb8-408a-b60e-ee7626259910 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:58.818977 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d411c09e-cfb8-408a-b60e-ee7626259910 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:58.819793 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d411c09e-cfb8-408a-b60e-ee7626259910 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:58.820248 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d411c09e-cfb8-408a-b60e-ee7626259910 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:58.843753 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-d411c09e-cfb8-408a-b60e-ee7626259910 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lazy-loading 'flavor' on Instance uuid 5c5ced7e-9d8b-4d24-a35d-876326b483ba {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:34:58.918762 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d411c09e-cfb8-408a-b60e-ee7626259910 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "POST /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba/action" status: 200 len: 32 microversion: 2.1 time: 0.116107 May 12 14:34:58.919404 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 223/432] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 12 14:34:58 2022] POST /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba/action => generated 32 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:34:58.929694 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c4d1fd40-0718-4d10-8484-ddab77870101 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:58.930326 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c4d1fd40-0718-4d10-8484-ddab77870101 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:58.936189 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c4d1fd40-0718-4d10-8484-ddab77870101 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:58.936651 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c4d1fd40-0718-4d10-8484-ddab77870101 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:58.937429 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c4d1fd40-0718-4d10-8484-ddab77870101 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:58.937880 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c4d1fd40-0718-4d10-8484-ddab77870101 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:59.073338 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c4d1fd40-0718-4d10-8484-ddab77870101 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:34:59.080936 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c4d1fd40-0718-4d10-8484-ddab77870101 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.155277 May 12 14:34:59.081511 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 210/433] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:58 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:34:59.820402 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-858be94a-a5dd-4ea8-b146-224ee038003a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:59.821113 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-858be94a-a5dd-4ea8-b146-224ee038003a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:59.826339 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-cc366379-7a40-45c0-a631-829340bb8d53 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:34:59.826963 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-cc366379-7a40-45c0-a631-829340bb8d53 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:34:59.828089 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-858be94a-a5dd-4ea8-b146-224ee038003a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:59.828549 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-858be94a-a5dd-4ea8-b146-224ee038003a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:59.829331 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-858be94a-a5dd-4ea8-b146-224ee038003a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:59.829770 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-858be94a-a5dd-4ea8-b146-224ee038003a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:59.833987 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cc366379-7a40-45c0-a631-829340bb8d53 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:59.834441 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cc366379-7a40-45c0-a631-829340bb8d53 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:34:59.835250 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cc366379-7a40-45c0-a631-829340bb8d53 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:34:59.835693 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cc366379-7a40-45c0-a631-829340bb8d53 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:00.031906 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-858be94a-a5dd-4ea8-b146-224ee038003a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:00.035318 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-cc366379-7a40-45c0-a631-829340bb8d53 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:00.040760 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-858be94a-a5dd-4ea8-b146-224ee038003a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:00.042404 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-858be94a-a5dd-4ea8-b146-224ee038003a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:00.043213 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-cc366379-7a40-45c0-a631-829340bb8d53 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.221088 May 12 14:35:00.043664 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-858be94a-a5dd-4ea8-b146-224ee038003a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.227975 May 12 14:35:00.044305 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 211/434] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:34:59 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:00.053911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 224/435] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:34:59 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:00.102076 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8f7c9c4f-cf35-49e4-a7bf-609dc241aa4e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:00.102076 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8f7c9c4f-cf35-49e4-a7bf-609dc241aa4e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:00.104911 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8f7c9c4f-cf35-49e4-a7bf-609dc241aa4e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:00.105370 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8f7c9c4f-cf35-49e4-a7bf-609dc241aa4e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:00.106160 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8f7c9c4f-cf35-49e4-a7bf-609dc241aa4e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:00.106613 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8f7c9c4f-cf35-49e4-a7bf-609dc241aa4e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:00.254992 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8f7c9c4f-cf35-49e4-a7bf-609dc241aa4e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:00.262364 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8f7c9c4f-cf35-49e4-a7bf-609dc241aa4e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.167970 May 12 14:35:00.262947 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 212/436] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:00 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:01.060228 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0f850871-6ca5-4b01-b019-90bc26a67581 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:01.060841 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0f850871-6ca5-4b01-b019-90bc26a67581 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:01.061192 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3d83cbbc-125d-4216-bce4-20470d27f428 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:01.061823 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3d83cbbc-125d-4216-bce4-20470d27f428 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:01.067320 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0f850871-6ca5-4b01-b019-90bc26a67581 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:01.067773 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0f850871-6ca5-4b01-b019-90bc26a67581 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:01.068134 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3d83cbbc-125d-4216-bce4-20470d27f428 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:01.068603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3d83cbbc-125d-4216-bce4-20470d27f428 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:01.069254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0f850871-6ca5-4b01-b019-90bc26a67581 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:01.069377 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3d83cbbc-125d-4216-bce4-20470d27f428 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:01.069687 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0f850871-6ca5-4b01-b019-90bc26a67581 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:01.069825 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3d83cbbc-125d-4216-bce4-20470d27f428 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:01.263765 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0f850871-6ca5-4b01-b019-90bc26a67581 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:01.273228 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3d83cbbc-125d-4216-bce4-20470d27f428 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:01.280141 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0f850871-6ca5-4b01-b019-90bc26a67581 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.223611 May 12 14:35:01.282053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 225/437] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:01 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:01.286543 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c83b3861-27e0-4bbf-84f3-330c93245018 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:01.287143 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c83b3861-27e0-4bbf-84f3-330c93245018 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:01.294773 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c83b3861-27e0-4bbf-84f3-330c93245018 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:01.295535 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c83b3861-27e0-4bbf-84f3-330c93245018 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:01.295656 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3d83cbbc-125d-4216-bce4-20470d27f428 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:01.296809 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c83b3861-27e0-4bbf-84f3-330c93245018 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:01.297655 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c83b3861-27e0-4bbf-84f3-330c93245018 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:01.298498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3d83cbbc-125d-4216-bce4-20470d27f428 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:01.301271 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3d83cbbc-125d-4216-bce4-20470d27f428 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.243622 May 12 14:35:01.302203 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 213/438] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:01 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:01.432175 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c83b3861-27e0-4bbf-84f3-330c93245018 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:01.439549 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c83b3861-27e0-4bbf-84f3-330c93245018 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.157807 May 12 14:35:01.440127 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 226/439] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:01 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:02.305426 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9fd74183-ded1-4fdf-a7a2-57547afc79e7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:02.306038 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9fd74183-ded1-4fdf-a7a2-57547afc79e7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:02.312980 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9fd74183-ded1-4fdf-a7a2-57547afc79e7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:02.314676 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9fd74183-ded1-4fdf-a7a2-57547afc79e7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:02.314676 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9fd74183-ded1-4fdf-a7a2-57547afc79e7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:02.314676 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9fd74183-ded1-4fdf-a7a2-57547afc79e7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:02.319938 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-83ad2dd6-3782-4e37-81ac-953ef639d610 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:02.321700 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-83ad2dd6-3782-4e37-81ac-953ef639d610 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:02.328959 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-83ad2dd6-3782-4e37-81ac-953ef639d610 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:02.329417 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-83ad2dd6-3782-4e37-81ac-953ef639d610 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:02.330337 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-83ad2dd6-3782-4e37-81ac-953ef639d610 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:02.330655 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-83ad2dd6-3782-4e37-81ac-953ef639d610 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:02.518111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9fd74183-ded1-4fdf-a7a2-57547afc79e7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:02.528605 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9fd74183-ded1-4fdf-a7a2-57547afc79e7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.226719 May 12 14:35:02.530161 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 214/440] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:02 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:02.533138 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-83ad2dd6-3782-4e37-81ac-953ef639d610 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:02.540622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b67958c7-5581-43c2-af9d-91f2a7347793 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:02.541247 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b67958c7-5581-43c2-af9d-91f2a7347793 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:02.547548 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-83ad2dd6-3782-4e37-81ac-953ef639d610 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:02.547826 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b67958c7-5581-43c2-af9d-91f2a7347793 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:02.548300 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b67958c7-5581-43c2-af9d-91f2a7347793 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:02.549607 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b67958c7-5581-43c2-af9d-91f2a7347793 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:02.550055 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b67958c7-5581-43c2-af9d-91f2a7347793 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:02.550589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-83ad2dd6-3782-4e37-81ac-953ef639d610 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:02.552731 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-83ad2dd6-3782-4e37-81ac-953ef639d610 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.236301 May 12 14:35:02.553663 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 227/441] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:02 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:02.727017 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b67958c7-5581-43c2-af9d-91f2a7347793 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:02.735129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b67958c7-5581-43c2-af9d-91f2a7347793 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.203269 May 12 14:35:02.735869 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 215/442] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:02 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:03.545739 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-79f8192c-cb5b-4968-adde-2c889e5f4594 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:03.546505 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-79f8192c-cb5b-4968-adde-2c889e5f4594 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:03.553588 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-79f8192c-cb5b-4968-adde-2c889e5f4594 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:03.554040 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-79f8192c-cb5b-4968-adde-2c889e5f4594 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:03.554843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-79f8192c-cb5b-4968-adde-2c889e5f4594 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:03.555325 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-79f8192c-cb5b-4968-adde-2c889e5f4594 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:03.577606 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5252171b-7c3f-438f-8c15-bfd14ba96a2d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:03.578218 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5252171b-7c3f-438f-8c15-bfd14ba96a2d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:03.584327 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5252171b-7c3f-438f-8c15-bfd14ba96a2d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:03.584786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5252171b-7c3f-438f-8c15-bfd14ba96a2d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:03.586317 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5252171b-7c3f-438f-8c15-bfd14ba96a2d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:03.586451 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5252171b-7c3f-438f-8c15-bfd14ba96a2d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:03.826248 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-79f8192c-cb5b-4968-adde-2c889e5f4594 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:03.834831 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-79f8192c-cb5b-4968-adde-2c889e5f4594 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.292847 May 12 14:35:03.835343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5252171b-7c3f-438f-8c15-bfd14ba96a2d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:03.835841 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 228/443] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:03 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:03.840461 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2d8947fc-1567-4332-93c6-71f2c683f7a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:03.841443 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2d8947fc-1567-4332-93c6-71f2c683f7a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:03.848478 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2d8947fc-1567-4332-93c6-71f2c683f7a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:03.849178 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2d8947fc-1567-4332-93c6-71f2c683f7a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:03.850443 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2d8947fc-1567-4332-93c6-71f2c683f7a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:03.851077 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2d8947fc-1567-4332-93c6-71f2c683f7a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:03.853565 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5252171b-7c3f-438f-8c15-bfd14ba96a2d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:03.855230 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5252171b-7c3f-438f-8c15-bfd14ba96a2d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:03.856851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5252171b-7c3f-438f-8c15-bfd14ba96a2d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.283089 May 12 14:35:03.858873 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 216/444] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:03 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:03.985811 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2d8947fc-1567-4332-93c6-71f2c683f7a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:03.993187 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2d8947fc-1567-4332-93c6-71f2c683f7a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.156403 May 12 14:35:03.993749 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 229/445] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:03 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:04.852355 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f2d27f3f-de9b-410d-8426-021a3be38c08 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:04.853315 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f2d27f3f-de9b-410d-8426-021a3be38c08 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:04.859870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f2d27f3f-de9b-410d-8426-021a3be38c08 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:04.860332 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f2d27f3f-de9b-410d-8426-021a3be38c08 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:04.863293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f2d27f3f-de9b-410d-8426-021a3be38c08 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:04.863293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f2d27f3f-de9b-410d-8426-021a3be38c08 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:04.879426 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-03891497-8bd5-4ff2-b1a5-7d65f7ac3ecc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:04.879985 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-03891497-8bd5-4ff2-b1a5-7d65f7ac3ecc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:04.886775 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-03891497-8bd5-4ff2-b1a5-7d65f7ac3ecc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:04.887287 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-03891497-8bd5-4ff2-b1a5-7d65f7ac3ecc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:04.888084 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-03891497-8bd5-4ff2-b1a5-7d65f7ac3ecc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:04.888528 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-03891497-8bd5-4ff2-b1a5-7d65f7ac3ecc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:05.078390 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f2d27f3f-de9b-410d-8426-021a3be38c08 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:05.082444 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-03891497-8bd5-4ff2-b1a5-7d65f7ac3ecc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:05.085809 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f2d27f3f-de9b-410d-8426-021a3be38c08 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.237818 May 12 14:35:05.086402 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 217/446] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:04 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:05.090480 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-03891497-8bd5-4ff2-b1a5-7d65f7ac3ecc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:05.090786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f17a5a5e-086d-4a46-a7bf-39099d159e06 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:05.091434 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f17a5a5e-086d-4a46-a7bf-39099d159e06 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:05.092273 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-03891497-8bd5-4ff2-b1a5-7d65f7ac3ecc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:05.093485 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-03891497-8bd5-4ff2-b1a5-7d65f7ac3ecc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.219390 May 12 14:35:05.094343 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 230/447] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:04 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:05.097734 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f17a5a5e-086d-4a46-a7bf-39099d159e06 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:05.098194 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f17a5a5e-086d-4a46-a7bf-39099d159e06 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:05.098978 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f17a5a5e-086d-4a46-a7bf-39099d159e06 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:05.099448 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f17a5a5e-086d-4a46-a7bf-39099d159e06 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:05.226557 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f17a5a5e-086d-4a46-a7bf-39099d159e06 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:05.233878 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f17a5a5e-086d-4a46-a7bf-39099d159e06 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.146517 May 12 14:35:05.234455 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 218/448] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:05 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:06.102993 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-34e68892-3ab4-402e-af8f-3e3f013be3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:06.103635 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-34e68892-3ab4-402e-af8f-3e3f013be3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:06.110046 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34e68892-3ab4-402e-af8f-3e3f013be3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:06.110493 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34e68892-3ab4-402e-af8f-3e3f013be3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:06.111291 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34e68892-3ab4-402e-af8f-3e3f013be3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:06.111727 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34e68892-3ab4-402e-af8f-3e3f013be3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:06.112251 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-24ad22a9-0bff-480a-a87e-1ae22b96dd59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:06.112870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-24ad22a9-0bff-480a-a87e-1ae22b96dd59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:06.119385 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-24ad22a9-0bff-480a-a87e-1ae22b96dd59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:06.119842 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-24ad22a9-0bff-480a-a87e-1ae22b96dd59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:06.120626 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-24ad22a9-0bff-480a-a87e-1ae22b96dd59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:06.121077 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-24ad22a9-0bff-480a-a87e-1ae22b96dd59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:06.299065 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-34e68892-3ab4-402e-af8f-3e3f013be3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:06.306628 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-34e68892-3ab4-402e-af8f-3e3f013be3b6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.207549 May 12 14:35:06.307247 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 231/449] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:06 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:06.311964 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d72f25d8-55a6-4498-b9d8-a8da1bd411af tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:06.312585 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d72f25d8-55a6-4498-b9d8-a8da1bd411af tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:06.314886 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-24ad22a9-0bff-480a-a87e-1ae22b96dd59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:06.319124 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d72f25d8-55a6-4498-b9d8-a8da1bd411af tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:06.319578 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d72f25d8-55a6-4498-b9d8-a8da1bd411af tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:06.320365 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d72f25d8-55a6-4498-b9d8-a8da1bd411af tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:06.320835 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d72f25d8-55a6-4498-b9d8-a8da1bd411af tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:06.323250 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-24ad22a9-0bff-480a-a87e-1ae22b96dd59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:06.324805 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-24ad22a9-0bff-480a-a87e-1ae22b96dd59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:06.326017 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-24ad22a9-0bff-480a-a87e-1ae22b96dd59 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.217786 May 12 14:35:06.326582 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 219/450] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:06 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:06.452244 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d72f25d8-55a6-4498-b9d8-a8da1bd411af tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:06.459614 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d72f25d8-55a6-4498-b9d8-a8da1bd411af tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.151404 May 12 14:35:06.460193 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 232/451] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:06 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:07.324190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d7adf477-52ba-48ac-a030-1dc801e95222 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:07.324812 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d7adf477-52ba-48ac-a030-1dc801e95222 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:07.331222 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d7adf477-52ba-48ac-a030-1dc801e95222 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:07.331679 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d7adf477-52ba-48ac-a030-1dc801e95222 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:07.332451 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d7adf477-52ba-48ac-a030-1dc801e95222 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:07.332896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d7adf477-52ba-48ac-a030-1dc801e95222 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:07.343881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2c45335b-61e9-46ec-8f0e-63ee32a1ca98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:07.344500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2c45335b-61e9-46ec-8f0e-63ee32a1ca98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:07.351170 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c45335b-61e9-46ec-8f0e-63ee32a1ca98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:07.351629 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c45335b-61e9-46ec-8f0e-63ee32a1ca98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:07.352407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c45335b-61e9-46ec-8f0e-63ee32a1ca98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:07.352846 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c45335b-61e9-46ec-8f0e-63ee32a1ca98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:07.509829 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d7adf477-52ba-48ac-a030-1dc801e95222 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:07.517947 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d7adf477-52ba-48ac-a030-1dc801e95222 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.197090 May 12 14:35:07.518618 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 220/452] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:07 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:07.523145 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-40dd07dc-b7c5-4607-9ae1-9ef547e3c10b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:07.523761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-40dd07dc-b7c5-4607-9ae1-9ef547e3c10b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:07.529410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-40dd07dc-b7c5-4607-9ae1-9ef547e3c10b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:07.529870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-40dd07dc-b7c5-4607-9ae1-9ef547e3c10b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:07.530646 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-40dd07dc-b7c5-4607-9ae1-9ef547e3c10b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:07.531110 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-40dd07dc-b7c5-4607-9ae1-9ef547e3c10b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:07.531834 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2c45335b-61e9-46ec-8f0e-63ee32a1ca98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:07.539666 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2c45335b-61e9-46ec-8f0e-63ee32a1ca98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:07.541189 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2c45335b-61e9-46ec-8f0e-63ee32a1ca98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:07.542345 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2c45335b-61e9-46ec-8f0e-63ee32a1ca98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.202619 May 12 14:35:07.542913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 233/453] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:07 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:07.657659 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-40dd07dc-b7c5-4607-9ae1-9ef547e3c10b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:07.665076 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-40dd07dc-b7c5-4607-9ae1-9ef547e3c10b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.145471 May 12 14:35:07.665649 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 221/454] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:07 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:08.535182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6c9c72b7-f848-46d4-bc49-a0ed81480c25 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:08.535804 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6c9c72b7-f848-46d4-bc49-a0ed81480c25 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:08.542215 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c9c72b7-f848-46d4-bc49-a0ed81480c25 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:08.542673 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c9c72b7-f848-46d4-bc49-a0ed81480c25 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:08.543546 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c9c72b7-f848-46d4-bc49-a0ed81480c25 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:08.543996 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c9c72b7-f848-46d4-bc49-a0ed81480c25 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:08.560095 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-21760f2d-afd3-41f3-b58a-ab7f7b1ec9e8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:08.560736 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-21760f2d-afd3-41f3-b58a-ab7f7b1ec9e8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:08.566922 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-21760f2d-afd3-41f3-b58a-ab7f7b1ec9e8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:08.567409 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-21760f2d-afd3-41f3-b58a-ab7f7b1ec9e8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:08.568183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-21760f2d-afd3-41f3-b58a-ab7f7b1ec9e8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:08.568623 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-21760f2d-afd3-41f3-b58a-ab7f7b1ec9e8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:08.736939 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6c9c72b7-f848-46d4-bc49-a0ed81480c25 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:08.744308 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6c9c72b7-f848-46d4-bc49-a0ed81480c25 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.213618 May 12 14:35:08.744891 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 234/455] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:08 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:08.749562 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b1f33618-c1a5-4190-936b-f2f6832f26ef tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:08.750171 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b1f33618-c1a5-4190-936b-f2f6832f26ef tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:08.752014 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-21760f2d-afd3-41f3-b58a-ab7f7b1ec9e8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:08.756681 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b1f33618-c1a5-4190-936b-f2f6832f26ef tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:08.757170 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b1f33618-c1a5-4190-936b-f2f6832f26ef tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:08.758003 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b1f33618-c1a5-4190-936b-f2f6832f26ef tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:08.758438 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b1f33618-c1a5-4190-936b-f2f6832f26ef tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:08.760613 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-21760f2d-afd3-41f3-b58a-ab7f7b1ec9e8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:08.762237 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-21760f2d-afd3-41f3-b58a-ab7f7b1ec9e8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:08.763565 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-21760f2d-afd3-41f3-b58a-ab7f7b1ec9e8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.207365 May 12 14:35:08.764301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 222/456] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:08 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:08.887708 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b1f33618-c1a5-4190-936b-f2f6832f26ef tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:08.895614 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b1f33618-c1a5-4190-936b-f2f6832f26ef tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.149753 May 12 14:35:08.896188 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 235/457] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:08 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:09.761803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-802e2665-8c2c-4a36-8c72-fb89d16ae897 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:09.762423 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-802e2665-8c2c-4a36-8c72-fb89d16ae897 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:09.768993 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-802e2665-8c2c-4a36-8c72-fb89d16ae897 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:09.769450 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-802e2665-8c2c-4a36-8c72-fb89d16ae897 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:09.770263 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-802e2665-8c2c-4a36-8c72-fb89d16ae897 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:09.770711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-802e2665-8c2c-4a36-8c72-fb89d16ae897 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:09.781626 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e39e97c7-d364-42be-b9de-46e46e862200 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:09.782238 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e39e97c7-d364-42be-b9de-46e46e862200 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:09.789044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e39e97c7-d364-42be-b9de-46e46e862200 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:09.789497 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e39e97c7-d364-42be-b9de-46e46e862200 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:09.790268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e39e97c7-d364-42be-b9de-46e46e862200 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:09.790703 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e39e97c7-d364-42be-b9de-46e46e862200 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:09.971991 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-802e2665-8c2c-4a36-8c72-fb89d16ae897 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:09.979373 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e39e97c7-d364-42be-b9de-46e46e862200 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:09.980243 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-802e2665-8c2c-4a36-8c72-fb89d16ae897 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.221912 May 12 14:35:09.981291 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 223/458] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:09 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:09.986027 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a9e068e8-55b7-4d26-be0c-5963be17653a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:09.986891 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a9e068e8-55b7-4d26-be0c-5963be17653a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:09.990431 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e39e97c7-d364-42be-b9de-46e46e862200 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:09.992331 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e39e97c7-d364-42be-b9de-46e46e862200 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:09.993481 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a9e068e8-55b7-4d26-be0c-5963be17653a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:09.993701 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e39e97c7-d364-42be-b9de-46e46e862200 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.215925 May 12 14:35:09.993931 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a9e068e8-55b7-4d26-be0c-5963be17653a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:09.994289 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 236/459] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:09 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:09.994713 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a9e068e8-55b7-4d26-be0c-5963be17653a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:09.995354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a9e068e8-55b7-4d26-be0c-5963be17653a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:10.125095 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a9e068e8-55b7-4d26-be0c-5963be17653a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:10.133143 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a9e068e8-55b7-4d26-be0c-5963be17653a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.150725 May 12 14:35:10.133714 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 224/460] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:09 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:10.398425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-b815dea7-3759-4c0a-88ea-53a5b745580a req-e8a8bc99-dc54-4a14-9183-04a2344867b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a95d03a-223b-49bc-ba3a-afc4119c02c1", "name": "network-vif-plugged", "status": "completed", "tag": "f024020e-bf8c-4cf9-8ca2-23128204e9b2"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:35:10.406675 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-b815dea7-3759-4c0a-88ea-53a5b745580a req-e8a8bc99-dc54-4a14-9183-04a2344867b8 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:10.406947 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-b815dea7-3759-4c0a-88ea-53a5b745580a req-e8a8bc99-dc54-4a14-9183-04a2344867b8 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:10.421104 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-b815dea7-3759-4c0a-88ea-53a5b745580a req-e8a8bc99-dc54-4a14-9183-04a2344867b8 service nova] Creating event network-vif-plugged:f024020e-bf8c-4cf9-8ca2-23128204e9b2 for instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 on hv-cinder-77703 May 12 14:35:10.427713 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-b815dea7-3759-4c0a-88ea-53a5b745580a req-e8a8bc99-dc54-4a14-9183-04a2344867b8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033262 May 12 14:35:10.428315 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 237/461] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:35:10.997187 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-721629ab-4a07-4225-99b1-cf098da8eeb2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:10.997815 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-721629ab-4a07-4225-99b1-cf098da8eeb2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:11.005048 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-721629ab-4a07-4225-99b1-cf098da8eeb2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:11.005556 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-721629ab-4a07-4225-99b1-cf098da8eeb2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:11.013445 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7f293ef3-5460-4352-ae1f-4ba9a5ad1c9f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:11.014248 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7f293ef3-5460-4352-ae1f-4ba9a5ad1c9f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:11.014488 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-721629ab-4a07-4225-99b1-cf098da8eeb2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:11.014961 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-721629ab-4a07-4225-99b1-cf098da8eeb2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:11.021355 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7f293ef3-5460-4352-ae1f-4ba9a5ad1c9f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:11.021898 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7f293ef3-5460-4352-ae1f-4ba9a5ad1c9f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:11.022751 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7f293ef3-5460-4352-ae1f-4ba9a5ad1c9f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:11.023317 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7f293ef3-5460-4352-ae1f-4ba9a5ad1c9f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:11.274340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-721629ab-4a07-4225-99b1-cf098da8eeb2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:11.281845 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7f293ef3-5460-4352-ae1f-4ba9a5ad1c9f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:11.284169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-721629ab-4a07-4225-99b1-cf098da8eeb2 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.289557 May 12 14:35:11.285703 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 225/462] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:10 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:35:11.293879 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-25cd79dc-d2d3-4e8b-9a67-9050000775cb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:11.294913 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-25cd79dc-d2d3-4e8b-9a67-9050000775cb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:11.301933 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-25cd79dc-d2d3-4e8b-9a67-9050000775cb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:11.302627 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-25cd79dc-d2d3-4e8b-9a67-9050000775cb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:11.303626 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-25cd79dc-d2d3-4e8b-9a67-9050000775cb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:11.304261 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-25cd79dc-d2d3-4e8b-9a67-9050000775cb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:11.304936 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7f293ef3-5460-4352-ae1f-4ba9a5ad1c9f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:11.307125 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7f293ef3-5460-4352-ae1f-4ba9a5ad1c9f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:11.308473 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7f293ef3-5460-4352-ae1f-4ba9a5ad1c9f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.299335 May 12 14:35:11.309156 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 238/463] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:11 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:11.449802 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-25cd79dc-d2d3-4e8b-9a67-9050000775cb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:11.457892 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-25cd79dc-d2d3-4e8b-9a67-9050000775cb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.170621 May 12 14:35:11.458470 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 226/464] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:11 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:12.300669 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-104b2655-764a-4659-8381-c9927d66ada0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:12.301309 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-104b2655-764a-4659-8381-c9927d66ada0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:12.307718 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-104b2655-764a-4659-8381-c9927d66ada0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:12.308176 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-104b2655-764a-4659-8381-c9927d66ada0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:12.308953 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-104b2655-764a-4659-8381-c9927d66ada0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:12.309396 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-104b2655-764a-4659-8381-c9927d66ada0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:12.326717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7825a04b-7488-4176-b55b-91918dc9dfe0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:12.327459 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7825a04b-7488-4176-b55b-91918dc9dfe0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:12.334279 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7825a04b-7488-4176-b55b-91918dc9dfe0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:12.334737 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7825a04b-7488-4176-b55b-91918dc9dfe0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:12.335662 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7825a04b-7488-4176-b55b-91918dc9dfe0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:12.336107 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7825a04b-7488-4176-b55b-91918dc9dfe0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:12.490168 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-104b2655-764a-4659-8381-c9927d66ada0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:12.498359 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-104b2655-764a-4659-8381-c9927d66ada0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.201059 May 12 14:35:12.507440 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 239/465] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:12 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:12.512587 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7825a04b-7488-4176-b55b-91918dc9dfe0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:12.512852 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2c2a968b-f3d9-4e98-8c5a-5c52b0ca85a6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:12.513471 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2c2a968b-f3d9-4e98-8c5a-5c52b0ca85a6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:12.520108 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c2a968b-f3d9-4e98-8c5a-5c52b0ca85a6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:12.520599 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c2a968b-f3d9-4e98-8c5a-5c52b0ca85a6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:12.521418 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7825a04b-7488-4176-b55b-91918dc9dfe0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:12.521559 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c2a968b-f3d9-4e98-8c5a-5c52b0ca85a6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:12.521862 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c2a968b-f3d9-4e98-8c5a-5c52b0ca85a6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:12.522952 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7825a04b-7488-4176-b55b-91918dc9dfe0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:12.524174 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7825a04b-7488-4176-b55b-91918dc9dfe0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.201342 May 12 14:35:12.524771 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 227/466] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:12 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:12.653506 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2c2a968b-f3d9-4e98-8c5a-5c52b0ca85a6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:12.661160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2c2a968b-f3d9-4e98-8c5a-5c52b0ca85a6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.152378 May 12 14:35:12.661740 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 240/467] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:12 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:13.514860 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1ebfce8c-bdb3-45ed-b2a8-4c2dbaf98c1d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:13.515510 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1ebfce8c-bdb3-45ed-b2a8-4c2dbaf98c1d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:13.521909 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1ebfce8c-bdb3-45ed-b2a8-4c2dbaf98c1d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:13.522373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1ebfce8c-bdb3-45ed-b2a8-4c2dbaf98c1d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:13.523192 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1ebfce8c-bdb3-45ed-b2a8-4c2dbaf98c1d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:13.523643 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1ebfce8c-bdb3-45ed-b2a8-4c2dbaf98c1d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:13.542960 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8f4a03aa-da5d-4270-84f2-80ee9f8053a4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:13.543625 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-8f4a03aa-da5d-4270-84f2-80ee9f8053a4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:13.550678 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8f4a03aa-da5d-4270-84f2-80ee9f8053a4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:13.551144 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8f4a03aa-da5d-4270-84f2-80ee9f8053a4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:13.552039 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8f4a03aa-da5d-4270-84f2-80ee9f8053a4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:13.552478 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8f4a03aa-da5d-4270-84f2-80ee9f8053a4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:13.699981 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1ebfce8c-bdb3-45ed-b2a8-4c2dbaf98c1d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:13.707874 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1ebfce8c-bdb3-45ed-b2a8-4c2dbaf98c1d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.196802 May 12 14:35:13.708474 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 228/468] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:13 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:13.713173 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-97904c65-c381-4b8e-a249-4561b435af1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:13.713792 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-97904c65-c381-4b8e-a249-4561b435af1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:13.720923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97904c65-c381-4b8e-a249-4561b435af1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:13.721126 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97904c65-c381-4b8e-a249-4561b435af1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:13.721783 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97904c65-c381-4b8e-a249-4561b435af1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:13.722222 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97904c65-c381-4b8e-a249-4561b435af1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:13.730725 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8f4a03aa-da5d-4270-84f2-80ee9f8053a4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:13.738770 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8f4a03aa-da5d-4270-84f2-80ee9f8053a4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:13.740312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8f4a03aa-da5d-4270-84f2-80ee9f8053a4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:13.741472 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8f4a03aa-da5d-4270-84f2-80ee9f8053a4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.202495 May 12 14:35:13.742145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 241/469] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:13 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:13.852777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-97904c65-c381-4b8e-a249-4561b435af1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:13.860862 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-97904c65-c381-4b8e-a249-4561b435af1a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.151137 May 12 14:35:13.861388 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 229/470] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:13 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:14.724383 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1ea9b976-6c3a-42e0-8d87-64954584000a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:14.724951 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1ea9b976-6c3a-42e0-8d87-64954584000a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:14.731303 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ea9b976-6c3a-42e0-8d87-64954584000a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:14.731764 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ea9b976-6c3a-42e0-8d87-64954584000a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:14.732540 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ea9b976-6c3a-42e0-8d87-64954584000a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:14.732983 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ea9b976-6c3a-42e0-8d87-64954584000a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:14.759972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-6cd2a3c6-65f4-46dd-b111-67aab4558eae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:14.760586 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-6cd2a3c6-65f4-46dd-b111-67aab4558eae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:14.766963 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6cd2a3c6-65f4-46dd-b111-67aab4558eae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:14.767505 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6cd2a3c6-65f4-46dd-b111-67aab4558eae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:14.768286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6cd2a3c6-65f4-46dd-b111-67aab4558eae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:14.768729 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6cd2a3c6-65f4-46dd-b111-67aab4558eae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:14.914359 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1ea9b976-6c3a-42e0-8d87-64954584000a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:14.921617 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1ea9b976-6c3a-42e0-8d87-64954584000a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.201257 May 12 14:35:14.922280 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 242/471] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:14 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:14.927440 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-702f7e43-e00a-468c-8e74-85a3a751ace0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:14.928060 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-702f7e43-e00a-468c-8e74-85a3a751ace0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:14.933766 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-702f7e43-e00a-468c-8e74-85a3a751ace0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:14.934222 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-702f7e43-e00a-468c-8e74-85a3a751ace0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:14.934999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-702f7e43-e00a-468c-8e74-85a3a751ace0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:14.935463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-702f7e43-e00a-468c-8e74-85a3a751ace0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:14.941981 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-6cd2a3c6-65f4-46dd-b111-67aab4558eae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:14.950507 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-6cd2a3c6-65f4-46dd-b111-67aab4558eae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:14.952047 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-6cd2a3c6-65f4-46dd-b111-67aab4558eae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:14.953218 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-6cd2a3c6-65f4-46dd-b111-67aab4558eae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.197148 May 12 14:35:14.953793 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 230/472] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:14 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:15.064600 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-702f7e43-e00a-468c-8e74-85a3a751ace0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:15.071968 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-702f7e43-e00a-468c-8e74-85a3a751ace0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.148742 May 12 14:35:15.072534 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 243/473] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:14 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:15.938458 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d4c9036a-9307-4d12-b3dd-286b099538aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:15.939157 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d4c9036a-9307-4d12-b3dd-286b099538aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:15.945729 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d4c9036a-9307-4d12-b3dd-286b099538aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:15.946208 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d4c9036a-9307-4d12-b3dd-286b099538aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:15.947018 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d4c9036a-9307-4d12-b3dd-286b099538aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:15.947570 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d4c9036a-9307-4d12-b3dd-286b099538aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:15.971147 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3da33e9e-b3f4-430a-ace5-6fabe56305dd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:15.971920 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3da33e9e-b3f4-430a-ace5-6fabe56305dd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:15.978252 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3da33e9e-b3f4-430a-ace5-6fabe56305dd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:15.978702 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3da33e9e-b3f4-430a-ace5-6fabe56305dd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:15.979517 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3da33e9e-b3f4-430a-ace5-6fabe56305dd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:15.979983 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3da33e9e-b3f4-430a-ace5-6fabe56305dd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:16.148471 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d4c9036a-9307-4d12-b3dd-286b099538aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:16.151690 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3da33e9e-b3f4-430a-ace5-6fabe56305dd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:16.156131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d4c9036a-9307-4d12-b3dd-286b099538aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.221371 May 12 14:35:16.156823 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 231/474] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:15 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:16.160236 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3da33e9e-b3f4-430a-ace5-6fabe56305dd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:16.161753 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3da33e9e-b3f4-430a-ace5-6fabe56305dd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:16.162921 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3da33e9e-b3f4-430a-ace5-6fabe56305dd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.196473 May 12 14:35:16.163657 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 244/475] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:15 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:16.165649 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8c3d4313-ff0f-4121-8f43-1cf00bbfe5a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:16.166814 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8c3d4313-ff0f-4121-8f43-1cf00bbfe5a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:16.176554 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8c3d4313-ff0f-4121-8f43-1cf00bbfe5a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:16.177008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8c3d4313-ff0f-4121-8f43-1cf00bbfe5a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:16.177800 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8c3d4313-ff0f-4121-8f43-1cf00bbfe5a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:16.178236 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8c3d4313-ff0f-4121-8f43-1cf00bbfe5a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:16.314546 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8c3d4313-ff0f-4121-8f43-1cf00bbfe5a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:16.321853 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8c3d4313-ff0f-4121-8f43-1cf00bbfe5a4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.163718 May 12 14:35:16.322430 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 232/476] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:16 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:17.181689 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-740a8254-c9f1-4c66-af6a-323a163393da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:17.182225 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-936c4cdd-c03a-4e98-829c-a7a6752ffa58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:17.182621 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-740a8254-c9f1-4c66-af6a-323a163393da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:17.182718 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-936c4cdd-c03a-4e98-829c-a7a6752ffa58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:17.188814 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-740a8254-c9f1-4c66-af6a-323a163393da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:17.188950 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-936c4cdd-c03a-4e98-829c-a7a6752ffa58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:17.189204 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-740a8254-c9f1-4c66-af6a-323a163393da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:17.189315 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-936c4cdd-c03a-4e98-829c-a7a6752ffa58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:17.189986 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-740a8254-c9f1-4c66-af6a-323a163393da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:17.190087 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-936c4cdd-c03a-4e98-829c-a7a6752ffa58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:17.190427 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-740a8254-c9f1-4c66-af6a-323a163393da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:17.190541 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-936c4cdd-c03a-4e98-829c-a7a6752ffa58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:17.382914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-740a8254-c9f1-4c66-af6a-323a163393da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:17.389298 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-936c4cdd-c03a-4e98-829c-a7a6752ffa58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:17.392351 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-740a8254-c9f1-4c66-af6a-323a163393da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:17.393989 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-740a8254-c9f1-4c66-af6a-323a163393da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:17.395203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-740a8254-c9f1-4c66-af6a-323a163393da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.217421 May 12 14:35:17.395764 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 245/477] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:17 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:17.396635 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-936c4cdd-c03a-4e98-829c-a7a6752ffa58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.218651 May 12 14:35:17.397350 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 233/478] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:17 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:35:17.400479 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6e196222-3152-493e-9b15-43762342550b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:17.401083 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6e196222-3152-493e-9b15-43762342550b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:17.407062 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6e196222-3152-493e-9b15-43762342550b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:17.408019 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6e196222-3152-493e-9b15-43762342550b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:17.408784 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6e196222-3152-493e-9b15-43762342550b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:17.409234 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6e196222-3152-493e-9b15-43762342550b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:17.542112 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6e196222-3152-493e-9b15-43762342550b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:17.549386 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6e196222-3152-493e-9b15-43762342550b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.152677 May 12 14:35:17.549951 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 246/479] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:17 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:18.413854 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5151f729-c6df-4a84-8304-c7ec1dc3d1e0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:18.414472 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-78ae4232-c818-485b-8b19-760d5bbf4421 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:18.414872 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5151f729-c6df-4a84-8304-c7ec1dc3d1e0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:18.414975 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-78ae4232-c818-485b-8b19-760d5bbf4421 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:18.420929 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-78ae4232-c818-485b-8b19-760d5bbf4421 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:18.421092 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5151f729-c6df-4a84-8304-c7ec1dc3d1e0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:18.421381 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-78ae4232-c818-485b-8b19-760d5bbf4421 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:18.421495 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5151f729-c6df-4a84-8304-c7ec1dc3d1e0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:18.422168 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5151f729-c6df-4a84-8304-c7ec1dc3d1e0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:18.422506 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-78ae4232-c818-485b-8b19-760d5bbf4421 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:18.422651 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5151f729-c6df-4a84-8304-c7ec1dc3d1e0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:18.422946 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-78ae4232-c818-485b-8b19-760d5bbf4421 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:18.614184 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-78ae4232-c818-485b-8b19-760d5bbf4421 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:18.618078 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5151f729-c6df-4a84-8304-c7ec1dc3d1e0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:18.622093 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-78ae4232-c818-485b-8b19-760d5bbf4421 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:18.623627 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-78ae4232-c818-485b-8b19-760d5bbf4421 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:18.624783 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-78ae4232-c818-485b-8b19-760d5bbf4421 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.214695 May 12 14:35:18.625254 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5151f729-c6df-4a84-8304-c7ec1dc3d1e0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.215287 May 12 14:35:18.625366 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 247/480] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:18 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:18.633380 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 234/481] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:18 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:18.633556 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6f4481c4-2e01-4c22-bd98-0d00692b1680 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:18.633556 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6f4481c4-2e01-4c22-bd98-0d00692b1680 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:18.636898 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6f4481c4-2e01-4c22-bd98-0d00692b1680 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:18.637376 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6f4481c4-2e01-4c22-bd98-0d00692b1680 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:18.638188 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6f4481c4-2e01-4c22-bd98-0d00692b1680 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:18.638635 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6f4481c4-2e01-4c22-bd98-0d00692b1680 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:18.770215 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6f4481c4-2e01-4c22-bd98-0d00692b1680 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:18.777825 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6f4481c4-2e01-4c22-bd98-0d00692b1680 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.151284 May 12 14:35:18.778310 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 248/482] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:18 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:19.642420 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-11784e22-0ae6-4867-be5a-4a6019d0a84a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:19.643103 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-11784e22-0ae6-4867-be5a-4a6019d0a84a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:19.647917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ba2a6f3c-e6f2-451d-b24c-daadd3733713 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:19.648538 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ba2a6f3c-e6f2-451d-b24c-daadd3733713 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:19.649654 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-11784e22-0ae6-4867-be5a-4a6019d0a84a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:19.650123 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-11784e22-0ae6-4867-be5a-4a6019d0a84a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:19.650904 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-11784e22-0ae6-4867-be5a-4a6019d0a84a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:19.651393 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-11784e22-0ae6-4867-be5a-4a6019d0a84a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:19.654510 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ba2a6f3c-e6f2-451d-b24c-daadd3733713 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:19.654962 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ba2a6f3c-e6f2-451d-b24c-daadd3733713 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:19.655749 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ba2a6f3c-e6f2-451d-b24c-daadd3733713 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:19.656182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ba2a6f3c-e6f2-451d-b24c-daadd3733713 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:19.838611 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-11784e22-0ae6-4867-be5a-4a6019d0a84a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:19.846928 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-11784e22-0ae6-4867-be5a-4a6019d0a84a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:19.848490 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-11784e22-0ae6-4867-be5a-4a6019d0a84a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:19.849675 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-11784e22-0ae6-4867-be5a-4a6019d0a84a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.211205 May 12 14:35:19.849952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ba2a6f3c-e6f2-451d-b24c-daadd3733713 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:19.850243 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 235/483] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:19 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:19.854629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c108d198-1105-418a-b8ce-d9002fbaba0c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:19.855328 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c108d198-1105-418a-b8ce-d9002fbaba0c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:19.857297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ba2a6f3c-e6f2-451d-b24c-daadd3733713 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.218737 May 12 14:35:19.861026 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c108d198-1105-418a-b8ce-d9002fbaba0c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:19.861581 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c108d198-1105-418a-b8ce-d9002fbaba0c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:19.862425 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c108d198-1105-418a-b8ce-d9002fbaba0c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:19.862877 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c108d198-1105-418a-b8ce-d9002fbaba0c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:19.865268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 249/484] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:19 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:19.992414 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c108d198-1105-418a-b8ce-d9002fbaba0c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:19.999664 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c108d198-1105-418a-b8ce-d9002fbaba0c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.148467 May 12 14:35:20.000234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 236/485] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:19 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:20.868676 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d4fae61b-3637-4059-b67c-235383468875 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:20.869282 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d4fae61b-3637-4059-b67c-235383468875 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:20.873839 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-17538d04-aa9d-4998-9f9e-83b2e31e993d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:20.874463 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-17538d04-aa9d-4998-9f9e-83b2e31e993d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:20.877740 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d4fae61b-3637-4059-b67c-235383468875 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:20.878186 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d4fae61b-3637-4059-b67c-235383468875 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:20.879002 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d4fae61b-3637-4059-b67c-235383468875 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:20.879469 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d4fae61b-3637-4059-b67c-235383468875 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:20.881478 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-17538d04-aa9d-4998-9f9e-83b2e31e993d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:20.881993 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-17538d04-aa9d-4998-9f9e-83b2e31e993d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:20.882788 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-17538d04-aa9d-4998-9f9e-83b2e31e993d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:20.883261 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-17538d04-aa9d-4998-9f9e-83b2e31e993d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:21.064881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d4fae61b-3637-4059-b67c-235383468875 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:21.072744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d4fae61b-3637-4059-b67c-235383468875 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:21.074266 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d4fae61b-3637-4059-b67c-235383468875 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:21.075455 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d4fae61b-3637-4059-b67c-235383468875 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.210994 May 12 14:35:21.076377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 250/486] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:20 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:21.078707 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-17538d04-aa9d-4998-9f9e-83b2e31e993d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:21.081243 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7da010d8-4bda-4f77-b9b2-ecc2ba14a145 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:21.081740 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7da010d8-4bda-4f77-b9b2-ecc2ba14a145 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:21.087318 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-17538d04-aa9d-4998-9f9e-83b2e31e993d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.217465 May 12 14:35:21.087582 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7da010d8-4bda-4f77-b9b2-ecc2ba14a145 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:21.087913 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 237/487] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:20 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:35:21.088110 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7da010d8-4bda-4f77-b9b2-ecc2ba14a145 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:21.088811 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7da010d8-4bda-4f77-b9b2-ecc2ba14a145 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:21.089261 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7da010d8-4bda-4f77-b9b2-ecc2ba14a145 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:21.224523 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7da010d8-4bda-4f77-b9b2-ecc2ba14a145 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:21.232030 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7da010d8-4bda-4f77-b9b2-ecc2ba14a145 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.154875 May 12 14:35:21.232610 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 251/488] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:21 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:22.094574 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-43b50298-fb68-4255-bdda-b935433c6d88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:22.095816 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-43b50298-fb68-4255-bdda-b935433c6d88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:22.102414 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-43b50298-fb68-4255-bdda-b935433c6d88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:22.102877 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-43b50298-fb68-4255-bdda-b935433c6d88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:22.103704 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-43b50298-fb68-4255-bdda-b935433c6d88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:22.103889 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4a3839ab-a63e-4582-b0d0-129a49eff933 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:22.104344 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-43b50298-fb68-4255-bdda-b935433c6d88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:22.104657 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4a3839ab-a63e-4582-b0d0-129a49eff933 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:22.110853 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4a3839ab-a63e-4582-b0d0-129a49eff933 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:22.111334 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4a3839ab-a63e-4582-b0d0-129a49eff933 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:22.112101 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4a3839ab-a63e-4582-b0d0-129a49eff933 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:22.112535 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4a3839ab-a63e-4582-b0d0-129a49eff933 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:22.292201 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-43b50298-fb68-4255-bdda-b935433c6d88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:22.295547 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4a3839ab-a63e-4582-b0d0-129a49eff933 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:22.301202 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-43b50298-fb68-4255-bdda-b935433c6d88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:22.302823 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-43b50298-fb68-4255-bdda-b935433c6d88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:22.303934 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4a3839ab-a63e-4582-b0d0-129a49eff933 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.203847 May 12 14:35:22.304108 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-43b50298-fb68-4255-bdda-b935433c6d88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.213567 May 12 14:35:22.304511 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 252/489] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:22 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:35:22.305444 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 238/490] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:22 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:22.308964 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-5151a805-3e7d-4b5f-b6be-b2829802c510 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:22.310374 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-5151a805-3e7d-4b5f-b6be-b2829802c510 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:22.316922 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5151a805-3e7d-4b5f-b6be-b2829802c510 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:22.317376 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5151a805-3e7d-4b5f-b6be-b2829802c510 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:22.318155 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5151a805-3e7d-4b5f-b6be-b2829802c510 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:22.318592 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5151a805-3e7d-4b5f-b6be-b2829802c510 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:22.446224 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-5151a805-3e7d-4b5f-b6be-b2829802c510 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:22.453153 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-5151a805-3e7d-4b5f-b6be-b2829802c510 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.147701 May 12 14:35:22.453720 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 253/491] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:22 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:23.321290 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5dbc15b0-fb32-44ad-9353-e577cd6c5de8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:23.321909 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5dbc15b0-fb32-44ad-9353-e577cd6c5de8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:23.322477 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-fac77fc7-bb74-4e5c-8761-43d678088a6c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:23.323127 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-fac77fc7-bb74-4e5c-8761-43d678088a6c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:23.328536 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5dbc15b0-fb32-44ad-9353-e577cd6c5de8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:23.328996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5dbc15b0-fb32-44ad-9353-e577cd6c5de8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:23.329355 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fac77fc7-bb74-4e5c-8761-43d678088a6c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:23.329776 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5dbc15b0-fb32-44ad-9353-e577cd6c5de8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:23.329883 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fac77fc7-bb74-4e5c-8761-43d678088a6c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:23.330216 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5dbc15b0-fb32-44ad-9353-e577cd6c5de8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:23.330566 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fac77fc7-bb74-4e5c-8761-43d678088a6c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:23.331013 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fac77fc7-bb74-4e5c-8761-43d678088a6c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:23.527942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5dbc15b0-fb32-44ad-9353-e577cd6c5de8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:23.530703 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-fac77fc7-bb74-4e5c-8761-43d678088a6c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:23.536343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5dbc15b0-fb32-44ad-9353-e577cd6c5de8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.218877 May 12 14:35:23.536943 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 239/492] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:23 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:23.539214 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-fac77fc7-bb74-4e5c-8761-43d678088a6c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:23.540734 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-fac77fc7-bb74-4e5c-8761-43d678088a6c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:23.541440 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1a812b96-f339-4900-86d1-d2a6756c9162 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:23.541899 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-fac77fc7-bb74-4e5c-8761-43d678088a6c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.223361 May 12 14:35:23.542061 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1a812b96-f339-4900-86d1-d2a6756c9162 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:23.542779 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 254/493] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:23 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:23.549684 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1a812b96-f339-4900-86d1-d2a6756c9162 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:23.550142 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1a812b96-f339-4900-86d1-d2a6756c9162 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:23.550932 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1a812b96-f339-4900-86d1-d2a6756c9162 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:23.551419 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1a812b96-f339-4900-86d1-d2a6756c9162 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:23.682519 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1a812b96-f339-4900-86d1-d2a6756c9162 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:23.691898 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1a812b96-f339-4900-86d1-d2a6756c9162 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.152648 May 12 14:35:23.691898 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 240/494] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:23 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:24.554143 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7018a9e4-55e0-44c7-98cd-156ac430c5b9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:24.554751 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7018a9e4-55e0-44c7-98cd-156ac430c5b9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:24.560794 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ec981a07-a34d-4d1c-8e4c-d2205bddf39d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:24.561289 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7018a9e4-55e0-44c7-98cd-156ac430c5b9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:24.561441 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ec981a07-a34d-4d1c-8e4c-d2205bddf39d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:24.561585 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7018a9e4-55e0-44c7-98cd-156ac430c5b9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:24.562309 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7018a9e4-55e0-44c7-98cd-156ac430c5b9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:24.562749 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7018a9e4-55e0-44c7-98cd-156ac430c5b9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:24.568652 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ec981a07-a34d-4d1c-8e4c-d2205bddf39d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:24.569110 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ec981a07-a34d-4d1c-8e4c-d2205bddf39d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:24.569898 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ec981a07-a34d-4d1c-8e4c-d2205bddf39d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:24.570340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ec981a07-a34d-4d1c-8e4c-d2205bddf39d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:24.980066 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7018a9e4-55e0-44c7-98cd-156ac430c5b9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:24.987411 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ec981a07-a34d-4d1c-8e4c-d2205bddf39d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:24.987815 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7018a9e4-55e0-44c7-98cd-156ac430c5b9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.437510 May 12 14:35:24.988394 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 255/495] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:24 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:24.993102 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0e3aad8e-3f44-4c79-b08b-6002095c17dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:24.993715 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0e3aad8e-3f44-4c79-b08b-6002095c17dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:24.995619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ec981a07-a34d-4d1c-8e4c-d2205bddf39d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:24.997121 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ec981a07-a34d-4d1c-8e4c-d2205bddf39d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:24.998287 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ec981a07-a34d-4d1c-8e4c-d2205bddf39d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.441379 May 12 14:35:24.998841 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 241/496] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:24 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:24.999363 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0e3aad8e-3f44-4c79-b08b-6002095c17dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:24.999815 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0e3aad8e-3f44-4c79-b08b-6002095c17dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:25.000588 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0e3aad8e-3f44-4c79-b08b-6002095c17dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:25.001650 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0e3aad8e-3f44-4c79-b08b-6002095c17dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:25.133664 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0e3aad8e-3f44-4c79-b08b-6002095c17dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:25.141064 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0e3aad8e-3f44-4c79-b08b-6002095c17dc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.151718 May 12 14:35:25.141640 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 256/497] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:24 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:26.006018 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-671fb09f-cff1-42f6-91b8-714305f1533a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:26.006682 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-671fb09f-cff1-42f6-91b8-714305f1533a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:26.013571 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-671fb09f-cff1-42f6-91b8-714305f1533a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:26.014035 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-671fb09f-cff1-42f6-91b8-714305f1533a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:26.014826 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-671fb09f-cff1-42f6-91b8-714305f1533a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:26.015476 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-671fb09f-cff1-42f6-91b8-714305f1533a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:26.018356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f106fa66-bfc7-48c3-8798-b9e82a8756e4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:26.019145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f106fa66-bfc7-48c3-8798-b9e82a8756e4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:26.025646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f106fa66-bfc7-48c3-8798-b9e82a8756e4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:26.026210 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f106fa66-bfc7-48c3-8798-b9e82a8756e4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:26.027117 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f106fa66-bfc7-48c3-8798-b9e82a8756e4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:26.027635 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f106fa66-bfc7-48c3-8798-b9e82a8756e4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:26.207209 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-671fb09f-cff1-42f6-91b8-714305f1533a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:26.215147 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-671fb09f-cff1-42f6-91b8-714305f1533a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.213043 May 12 14:35:26.215878 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 242/498] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:26 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:26.221423 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4b1d01c7-d2b1-4a29-99e0-13be396e61f3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:26.222313 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4b1d01c7-d2b1-4a29-99e0-13be396e61f3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:26.229310 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4b1d01c7-d2b1-4a29-99e0-13be396e61f3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:26.229842 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4b1d01c7-d2b1-4a29-99e0-13be396e61f3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:26.231069 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4b1d01c7-d2b1-4a29-99e0-13be396e61f3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:26.231624 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4b1d01c7-d2b1-4a29-99e0-13be396e61f3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:26.236328 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f106fa66-bfc7-48c3-8798-b9e82a8756e4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:26.245007 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f106fa66-bfc7-48c3-8798-b9e82a8756e4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:26.246518 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f106fa66-bfc7-48c3-8798-b9e82a8756e4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:26.247910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f106fa66-bfc7-48c3-8798-b9e82a8756e4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.234489 May 12 14:35:26.248475 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 257/499] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:26 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:26.378652 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4b1d01c7-d2b1-4a29-99e0-13be396e61f3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:26.386548 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4b1d01c7-d2b1-4a29-99e0-13be396e61f3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.169344 May 12 14:35:26.388072 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 243/500] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:26 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:27.232590 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-bbe961c0-4dd1-4eda-8d70-8aaafe70fea0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:27.233238 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-bbe961c0-4dd1-4eda-8d70-8aaafe70fea0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:27.240047 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bbe961c0-4dd1-4eda-8d70-8aaafe70fea0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:27.240495 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bbe961c0-4dd1-4eda-8d70-8aaafe70fea0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:27.241275 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bbe961c0-4dd1-4eda-8d70-8aaafe70fea0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:27.241707 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bbe961c0-4dd1-4eda-8d70-8aaafe70fea0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:27.265766 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b8cb9898-cf91-4aef-94aa-ac399d90b8e7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:27.266387 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b8cb9898-cf91-4aef-94aa-ac399d90b8e7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:27.272561 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b8cb9898-cf91-4aef-94aa-ac399d90b8e7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:27.273026 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b8cb9898-cf91-4aef-94aa-ac399d90b8e7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:27.273820 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b8cb9898-cf91-4aef-94aa-ac399d90b8e7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:27.274268 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b8cb9898-cf91-4aef-94aa-ac399d90b8e7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:27.527463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-bbe961c0-4dd1-4eda-8d70-8aaafe70fea0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:27.534790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-bbe961c0-4dd1-4eda-8d70-8aaafe70fea0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1365 microversion: 2.1 time: 0.306010 May 12 14:35:27.535525 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 258/501] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:27 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:27.549274 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f1365d95-ef88-4a81-b67f-03dcfaa82895 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:27.549896 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f1365d95-ef88-4a81-b67f-03dcfaa82895 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:27.552179 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b8cb9898-cf91-4aef-94aa-ac399d90b8e7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:27.556514 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1365d95-ef88-4a81-b67f-03dcfaa82895 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:27.556981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1365d95-ef88-4a81-b67f-03dcfaa82895 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:27.557944 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1365d95-ef88-4a81-b67f-03dcfaa82895 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:27.558396 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f1365d95-ef88-4a81-b67f-03dcfaa82895 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:27.560632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b8cb9898-cf91-4aef-94aa-ac399d90b8e7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:27.564441 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b8cb9898-cf91-4aef-94aa-ac399d90b8e7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:27.565776 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b8cb9898-cf91-4aef-94aa-ac399d90b8e7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1743 microversion: 2.20 time: 0.303968 May 12 14:35:27.571322 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 244/502] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:27 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1743 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:27.698888 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f1365d95-ef88-4a81-b67f-03dcfaa82895 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:27.707468 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f1365d95-ef88-4a81-b67f-03dcfaa82895 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.162384 May 12 14:35:27.708233 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 259/503] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:27 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:28.508494 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-9b0c6ed4-f050-49cb-ad03-283cefa75017 req-5850c6ea-26ea-45da-983f-2c1e005a7543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e2a4c2-6255-4074-9a3c-e5159c3f7b87", "name": "network-vif-plugged", "status": "completed", "tag": "7fccb52d-a09a-4e64-adbe-8b42348d39c5"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:35:28.517905 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-9b0c6ed4-f050-49cb-ad03-283cefa75017 req-5850c6ea-26ea-45da-983f-2c1e005a7543 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:28.518259 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-9b0c6ed4-f050-49cb-ad03-283cefa75017 req-5850c6ea-26ea-45da-983f-2c1e005a7543 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:28.532493 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-9b0c6ed4-f050-49cb-ad03-283cefa75017 req-5850c6ea-26ea-45da-983f-2c1e005a7543 service nova] Creating event network-vif-plugged:7fccb52d-a09a-4e64-adbe-8b42348d39c5 for instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 on hv-cinder-77703 May 12 14:35:28.536106 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-9b0c6ed4-f050-49cb-ad03-283cefa75017 req-5850c6ea-26ea-45da-983f-2c1e005a7543 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031515 May 12 14:35:28.536768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 245/504] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:35:28.551420 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-74fe8a18-0067-4d34-9bab-e77c8f31bea8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:28.552062 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-74fe8a18-0067-4d34-9bab-e77c8f31bea8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:28.558404 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-74fe8a18-0067-4d34-9bab-e77c8f31bea8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:28.558862 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-74fe8a18-0067-4d34-9bab-e77c8f31bea8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:28.559666 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-74fe8a18-0067-4d34-9bab-e77c8f31bea8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:28.560116 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-74fe8a18-0067-4d34-9bab-e77c8f31bea8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:28.584854 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5e1b25ba-d025-4cf3-a3bd-80e5390b713b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:28.586320 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5e1b25ba-d025-4cf3-a3bd-80e5390b713b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:28.593257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5e1b25ba-d025-4cf3-a3bd-80e5390b713b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:28.593774 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5e1b25ba-d025-4cf3-a3bd-80e5390b713b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:28.595178 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5e1b25ba-d025-4cf3-a3bd-80e5390b713b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:28.596039 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5e1b25ba-d025-4cf3-a3bd-80e5390b713b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:28.751378 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-74fe8a18-0067-4d34-9bab-e77c8f31bea8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:28.758846 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-74fe8a18-0067-4d34-9bab-e77c8f31bea8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1554 microversion: 2.1 time: 0.212025 May 12 14:35:28.759459 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 260/505] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:28 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:28.763917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-20bff1c7-16c6-4397-8100-d5ba22d982ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:28.764527 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-20bff1c7-16c6-4397-8100-d5ba22d982ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:28.772273 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-20bff1c7-16c6-4397-8100-d5ba22d982ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:28.772800 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-20bff1c7-16c6-4397-8100-d5ba22d982ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:28.773687 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-20bff1c7-16c6-4397-8100-d5ba22d982ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:28.774201 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-20bff1c7-16c6-4397-8100-d5ba22d982ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:28.774901 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5e1b25ba-d025-4cf3-a3bd-80e5390b713b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:28.784935 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5e1b25ba-d025-4cf3-a3bd-80e5390b713b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:28.786447 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5e1b25ba-d025-4cf3-a3bd-80e5390b713b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:28.787795 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5e1b25ba-d025-4cf3-a3bd-80e5390b713b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1743 microversion: 2.20 time: 0.207212 May 12 14:35:28.788628 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 246/506] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:28 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1743 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:28.793724 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-09e9afdd-2190-42ac-b956-2f4f79bee910 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:28.794651 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-09e9afdd-2190-42ac-b956-2f4f79bee910 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:28.802130 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-09e9afdd-2190-42ac-b956-2f4f79bee910 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:28.802584 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-09e9afdd-2190-42ac-b956-2f4f79bee910 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:28.803386 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-09e9afdd-2190-42ac-b956-2f4f79bee910 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:28.804027 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-09e9afdd-2190-42ac-b956-2f4f79bee910 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:28.919828 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-09e9afdd-2190-42ac-b956-2f4f79bee910 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129775 May 12 14:35:28.920521 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 247/507] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 12 14:35:28 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:35:28.959770 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-20bff1c7-16c6-4397-8100-d5ba22d982ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:28.971337 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-20bff1c7-16c6-4397-8100-d5ba22d982ea tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.210766 May 12 14:35:28.971927 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 261/508] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:28 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:29.124361 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-979212110", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-273927603", "security_groups": [{"name": "tempest-secgroup-smoke-1101967427"}], "networks": [{"uuid": "7b5e5a95-1ebf-44c0-8df3-0ac0399ef8e9"}], "block_device_mapping_v2": [{"uuid": "32f8eb01-122b-4cad-baa5-375fa5aee167", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:35:29.239042 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.network.neutron [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] validate_networks() for [('7b5e5a95-1ebf-44c0-8df3-0ac0399ef8e9', None, None, None, None, None)] {{(pid=118217) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:35:29.620704 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Flavor limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:35:29.621308 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Image limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:35:29.621791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Flavor pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:35:29.622219 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Image pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:35:29.622641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:35:29.634591 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:29.635073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:29.635905 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:29.636347 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:29.653407 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Getting quotas for project d9bb0671fa894da79848c7c46e553b5e. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:35:29.657869 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Getting quotas for user 4a65b858f4644a619a9c34cb99251efb and project d9bb0671fa894da79848c7c46e553b5e. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:35:29.716194 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Going to run 1 instances... {{(pid=118217) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:35:29.718403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='32f8eb01-122b-4cad-baa5-375fa5aee167',volume_size=None,volume_type=None)] {{(pid=118217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:35:29.809332 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-fddda1b1-fa57-4034-a5a0-b2f2c8c7c991 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:29.809954 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-fddda1b1-fa57-4034-a5a0-b2f2c8c7c991 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:29.817230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fddda1b1-fa57-4034-a5a0-b2f2c8c7c991 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:29.817692 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fddda1b1-fa57-4034-a5a0-b2f2c8c7c991 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:29.818818 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fddda1b1-fa57-4034-a5a0-b2f2c8c7c991 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:29.819296 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fddda1b1-fa57-4034-a5a0-b2f2c8c7c991 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:29.858450 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-158e76ca-8957-4860-a80f-19773cd02ed5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.744530 May 12 14:35:29.859303 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 248/509] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:35:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:35:29.870047 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7ad6f269-fe40-4c39-8772-f99afaf56202 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:29.870581 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7ad6f269-fe40-4c39-8772-f99afaf56202 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:30.032013 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7ad6f269-fe40-4c39-8772-f99afaf56202 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:30.048829 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7ad6f269-fe40-4c39-8772-f99afaf56202 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1087 microversion: 2.1 time: 0.183512 May 12 14:35:30.049898 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 249/510] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:29 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1087 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:30.054690 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-b60d9713-d81f-4763-bc58-a1262e1a1bef req-adae804c-4cd4-43c8-92c4-1ff9ad8202e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a95d03a-223b-49bc-ba3a-afc4119c02c1", "tag": "f024020e-bf8c-4cf9-8ca2-23128204e9b2"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:35:30.065918 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-b60d9713-d81f-4763-bc58-a1262e1a1bef req-adae804c-4cd4-43c8-92c4-1ff9ad8202e9 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:30.066379 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-b60d9713-d81f-4763-bc58-a1262e1a1bef req-adae804c-4cd4-43c8-92c4-1ff9ad8202e9 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:30.078263 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-b60d9713-d81f-4763-bc58-a1262e1a1bef req-adae804c-4cd4-43c8-92c4-1ff9ad8202e9 service nova] Creating event network-changed:f024020e-bf8c-4cf9-8ca2-23128204e9b2 for instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 on hv-cinder-77703 May 12 14:35:30.083959 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-b60d9713-d81f-4763-bc58-a1262e1a1bef req-adae804c-4cd4-43c8-92c4-1ff9ad8202e9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032802 May 12 14:35:30.084931 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 250/511] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:35:30.089790 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1482af5a-3baa-42a7-9d96-343566b917fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:30.090505 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1482af5a-3baa-42a7-9d96-343566b917fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:30.096953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1482af5a-3baa-42a7-9d96-343566b917fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:30.097430 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1482af5a-3baa-42a7-9d96-343566b917fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:30.098215 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1482af5a-3baa-42a7-9d96-343566b917fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:30.098652 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1482af5a-3baa-42a7-9d96-343566b917fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:30.104189 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-fddda1b1-fa57-4034-a5a0-b2f2c8c7c991 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:30.113055 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-fddda1b1-fa57-4034-a5a0-b2f2c8c7c991 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:30.114603 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-fddda1b1-fa57-4034-a5a0-b2f2c8c7c991 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:30.116040 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-fddda1b1-fa57-4034-a5a0-b2f2c8c7c991 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1743 microversion: 2.20 time: 0.311229 May 12 14:35:30.117089 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 262/512] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:29 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1743 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:30.330916 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1482af5a-3baa-42a7-9d96-343566b917fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:30.338743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1482af5a-3baa-42a7-9d96-343566b917fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.252892 May 12 14:35:30.339502 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 251/513] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:30 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:31.074060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1cb98fdb-4daf-449a-8b55-34712cc4f50e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:31.074718 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1cb98fdb-4daf-449a-8b55-34712cc4f50e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:31.080726 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7372b211-32a0-490d-8636-f149154d57b7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:31.082075 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7372b211-32a0-490d-8636-f149154d57b7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:31.086621 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1cb98fdb-4daf-449a-8b55-34712cc4f50e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:31.087137 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1cb98fdb-4daf-449a-8b55-34712cc4f50e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:31.087909 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1cb98fdb-4daf-449a-8b55-34712cc4f50e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:31.088354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1cb98fdb-4daf-449a-8b55-34712cc4f50e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:31.092036 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7372b211-32a0-490d-8636-f149154d57b7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:31.092746 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7372b211-32a0-490d-8636-f149154d57b7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:31.095254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7372b211-32a0-490d-8636-f149154d57b7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:31.096249 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7372b211-32a0-490d-8636-f149154d57b7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:31.195777 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7372b211-32a0-490d-8636-f149154d57b7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:31.207898 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7372b211-32a0-490d-8636-f149154d57b7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1193 microversion: 2.1 time: 0.145912 May 12 14:35:31.208490 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 263/514] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:31 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1193 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:31.217392 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9ffa3f51-7c3d-46af-978a-3a1f0cc2bcdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:31.224716 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9ffa3f51-7c3d-46af-978a-3a1f0cc2bcdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:31.235491 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9ffa3f51-7c3d-46af-978a-3a1f0cc2bcdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:31.236229 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9ffa3f51-7c3d-46af-978a-3a1f0cc2bcdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:31.237192 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9ffa3f51-7c3d-46af-978a-3a1f0cc2bcdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:31.237782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9ffa3f51-7c3d-46af-978a-3a1f0cc2bcdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:31.277929 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-1cb98fdb-4daf-449a-8b55-34712cc4f50e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lazy-loading 'services' on Instance uuid 7f0d59a6-8822-4d8d-83c9-390537c9818a {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:35:31.448110 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9ffa3f51-7c3d-46af-978a-3a1f0cc2bcdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:31.457729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9ffa3f51-7c3d-46af-978a-3a1f0cc2bcdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:31.459304 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9ffa3f51-7c3d-46af-978a-3a1f0cc2bcdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:31.460487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9ffa3f51-7c3d-46af-978a-3a1f0cc2bcdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1743 microversion: 2.20 time: 0.248384 May 12 14:35:31.461064 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 264/515] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:31 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1743 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:31.465930 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f93e16c6-30fd-4b65-9030-0705d1580929 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:31.466084 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f93e16c6-30fd-4b65-9030-0705d1580929 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:31.468701 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1cb98fdb-4daf-449a-8b55-34712cc4f50e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "DELETE /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a/os-volume_attachments/ad170dd9-54b6-4e19-b976-7fbe22a0ee2a" status: 202 len: 0 microversion: 2.1 time: 0.398538 May 12 14:35:31.470091 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 252/516] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 12 14:35:31 2022] DELETE /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a/os-volume_attachments/ad170dd9-54b6-4e19-b976-7fbe22a0ee2a => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:35:31.475314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f93e16c6-30fd-4b65-9030-0705d1580929 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:31.475773 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f93e16c6-30fd-4b65-9030-0705d1580929 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:31.476569 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f93e16c6-30fd-4b65-9030-0705d1580929 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:31.477010 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f93e16c6-30fd-4b65-9030-0705d1580929 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:31.697574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f93e16c6-30fd-4b65-9030-0705d1580929 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:31.711004 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f93e16c6-30fd-4b65-9030-0705d1580929 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.248440 May 12 14:35:31.711987 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 265/517] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:31 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:32.226522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9464d2b1-6a0f-4975-8c78-8ec403cda6a6 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:32.227487 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9464d2b1-6a0f-4975-8c78-8ec403cda6a6 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:32.239795 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9464d2b1-6a0f-4975-8c78-8ec403cda6a6 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:32.240523 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9464d2b1-6a0f-4975-8c78-8ec403cda6a6 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:32.241326 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9464d2b1-6a0f-4975-8c78-8ec403cda6a6 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:32.241932 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9464d2b1-6a0f-4975-8c78-8ec403cda6a6 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:32.481940 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f8d32c24-03f5-4c39-a01a-4f5ca3ee9c66 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:32.482561 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f8d32c24-03f5-4c39-a01a-4f5ca3ee9c66 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:32.489643 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f8d32c24-03f5-4c39-a01a-4f5ca3ee9c66 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:32.490094 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f8d32c24-03f5-4c39-a01a-4f5ca3ee9c66 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:32.490873 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f8d32c24-03f5-4c39-a01a-4f5ca3ee9c66 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:32.491338 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f8d32c24-03f5-4c39-a01a-4f5ca3ee9c66 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:32.524842 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9464d2b1-6a0f-4975-8c78-8ec403cda6a6 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:32.532274 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9464d2b1-6a0f-4975-8c78-8ec403cda6a6 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1271 microversion: 2.1 time: 0.310459 May 12 14:35:32.533116 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 253/518] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:32 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1271 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:32.696835 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f8d32c24-03f5-4c39-a01a-4f5ca3ee9c66 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:32.704657 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f8d32c24-03f5-4c39-a01a-4f5ca3ee9c66 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:32.706185 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f8d32c24-03f5-4c39-a01a-4f5ca3ee9c66 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:32.707387 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f8d32c24-03f5-4c39-a01a-4f5ca3ee9c66 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1743 microversion: 2.20 time: 0.229452 May 12 14:35:32.707963 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 266/519] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:32 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1743 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:32.730774 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d0111e59-057b-4a35-b28d-10f94b0c96f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:32.731580 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d0111e59-057b-4a35-b28d-10f94b0c96f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:32.738296 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d0111e59-057b-4a35-b28d-10f94b0c96f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:32.738756 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d0111e59-057b-4a35-b28d-10f94b0c96f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:32.739573 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d0111e59-057b-4a35-b28d-10f94b0c96f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:32.740195 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d0111e59-057b-4a35-b28d-10f94b0c96f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:32.967864 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d0111e59-057b-4a35-b28d-10f94b0c96f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:32.978892 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d0111e59-057b-4a35-b28d-10f94b0c96f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.252606 May 12 14:35:32.980016 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 254/520] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:32 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:33.285094 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-e2e69913-2f37-4bcd-acd2-bf6b73010eaa req-19d6438e-6288-47d9-9dc7-b2fe382c341b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef", "tag": "228c90b8-3a08-410b-be25-ba639362a959"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:35:33.293067 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-e2e69913-2f37-4bcd-acd2-bf6b73010eaa req-19d6438e-6288-47d9-9dc7-b2fe382c341b service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:33.293513 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-e2e69913-2f37-4bcd-acd2-bf6b73010eaa req-19d6438e-6288-47d9-9dc7-b2fe382c341b service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:33.306175 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-e2e69913-2f37-4bcd-acd2-bf6b73010eaa req-19d6438e-6288-47d9-9dc7-b2fe382c341b service nova] Creating event network-changed:228c90b8-3a08-410b-be25-ba639362a959 for instance ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef on hv-cinder-77703 May 12 14:35:33.311934 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-e2e69913-2f37-4bcd-acd2-bf6b73010eaa req-19d6438e-6288-47d9-9dc7-b2fe382c341b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030737 May 12 14:35:33.315425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 267/521] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:35:33.551944 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-84a15787-909c-4db2-a1be-18d4f12af578 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:33.552504 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-84a15787-909c-4db2-a1be-18d4f12af578 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:33.558950 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-84a15787-909c-4db2-a1be-18d4f12af578 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:33.559454 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-84a15787-909c-4db2-a1be-18d4f12af578 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:33.560233 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-84a15787-909c-4db2-a1be-18d4f12af578 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:33.560694 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-84a15787-909c-4db2-a1be-18d4f12af578 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:33.691620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-84a15787-909c-4db2-a1be-18d4f12af578 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:33.699848 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-84a15787-909c-4db2-a1be-18d4f12af578 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.152382 May 12 14:35:33.700437 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 255/522] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:33 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:33.726997 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e1ab4b3e-e1d2-4206-a95f-8a2289100d03 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:33.727732 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e1ab4b3e-e1d2-4206-a95f-8a2289100d03 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:33.734091 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1ab4b3e-e1d2-4206-a95f-8a2289100d03 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:33.734538 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1ab4b3e-e1d2-4206-a95f-8a2289100d03 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:33.735921 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1ab4b3e-e1d2-4206-a95f-8a2289100d03 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:33.736362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1ab4b3e-e1d2-4206-a95f-8a2289100d03 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:33.882943 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e1ab4b3e-e1d2-4206-a95f-8a2289100d03 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:33.891086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e1ab4b3e-e1d2-4206-a95f-8a2289100d03 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:33.892626 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e1ab4b3e-e1d2-4206-a95f-8a2289100d03 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:33.893802 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e1ab4b3e-e1d2-4206-a95f-8a2289100d03 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1743 microversion: 2.20 time: 0.171556 May 12 14:35:33.894370 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 268/523] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:33 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:33.996735 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3e21c9c6-48b8-4eda-a810-ada4cb3ba71b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:33.997357 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3e21c9c6-48b8-4eda-a810-ada4cb3ba71b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:34.003864 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e21c9c6-48b8-4eda-a810-ada4cb3ba71b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:34.004326 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e21c9c6-48b8-4eda-a810-ada4cb3ba71b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:34.005132 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e21c9c6-48b8-4eda-a810-ada4cb3ba71b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:34.005578 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e21c9c6-48b8-4eda-a810-ada4cb3ba71b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:34.144844 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3e21c9c6-48b8-4eda-a810-ada4cb3ba71b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:34.153830 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3e21c9c6-48b8-4eda-a810-ada4cb3ba71b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.160909 May 12 14:35:34.154414 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 256/524] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:33 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:34.717036 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-67403f29-9c7d-4296-a14d-c1a13d981e32 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:34.717734 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-67403f29-9c7d-4296-a14d-c1a13d981e32 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:34.725697 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-67403f29-9c7d-4296-a14d-c1a13d981e32 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:34.726152 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-67403f29-9c7d-4296-a14d-c1a13d981e32 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:34.726951 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-67403f29-9c7d-4296-a14d-c1a13d981e32 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:34.727443 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-67403f29-9c7d-4296-a14d-c1a13d981e32 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:34.860762 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-67403f29-9c7d-4296-a14d-c1a13d981e32 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:34.868262 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-67403f29-9c7d-4296-a14d-c1a13d981e32 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.155106 May 12 14:35:34.868833 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 269/525] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:34 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:34.916600 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-caab21ae-0307-4128-a4d2-814e3f2e51f9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:34.917533 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-caab21ae-0307-4128-a4d2-814e3f2e51f9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:34.925011 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-caab21ae-0307-4128-a4d2-814e3f2e51f9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:34.925461 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-caab21ae-0307-4128-a4d2-814e3f2e51f9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:34.926236 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-caab21ae-0307-4128-a4d2-814e3f2e51f9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:34.926689 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-caab21ae-0307-4128-a4d2-814e3f2e51f9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:35.061366 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-caab21ae-0307-4128-a4d2-814e3f2e51f9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:35.070458 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-caab21ae-0307-4128-a4d2-814e3f2e51f9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:35.072305 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-caab21ae-0307-4128-a4d2-814e3f2e51f9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:35.073510 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-caab21ae-0307-4128-a4d2-814e3f2e51f9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1743 microversion: 2.20 time: 0.164272 May 12 14:35:35.074080 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 257/526] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:34 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:35.171015 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0e8bddc0-0ceb-44e0-9338-5b16d8290ddf tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:35.171583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0e8bddc0-0ceb-44e0-9338-5b16d8290ddf tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:35.178164 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0e8bddc0-0ceb-44e0-9338-5b16d8290ddf tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:35.178612 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0e8bddc0-0ceb-44e0-9338-5b16d8290ddf tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:35.179416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0e8bddc0-0ceb-44e0-9338-5b16d8290ddf tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:35.179853 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0e8bddc0-0ceb-44e0-9338-5b16d8290ddf tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:35.347305 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0e8bddc0-0ceb-44e0-9338-5b16d8290ddf tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:35.354858 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0e8bddc0-0ceb-44e0-9338-5b16d8290ddf tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.187693 May 12 14:35:35.355443 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 270/527] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:35 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:35.756056 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f7b1c419-19a0-4886-890c-7740d0619601 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:35.756942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f7b1c419-19a0-4886-890c-7740d0619601 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:35.764206 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f7b1c419-19a0-4886-890c-7740d0619601 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:35.764667 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f7b1c419-19a0-4886-890c-7740d0619601 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:35.765448 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f7b1c419-19a0-4886-890c-7740d0619601 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:35.765890 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f7b1c419-19a0-4886-890c-7740d0619601 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:35.792133 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f7b1c419-19a0-4886-890c-7740d0619601 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Going to try to terminate instance {{(pid=118217) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:35:35.870588 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f7b1c419-19a0-4886-890c-7740d0619601 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "DELETE /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 204 len: 0 microversion: 2.1 time: 0.121198 May 12 14:35:35.871213 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 258/528] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:35:35 2022] DELETE /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:35:35.880249 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8c05c4dd-c008-48fc-8647-7fcb909e80a6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:35.881444 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-8c05c4dd-c008-48fc-8647-7fcb909e80a6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:35.885683 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e046fbf9-e41d-460d-9a7e-2235c94b2966 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:35.886475 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e046fbf9-e41d-460d-9a7e-2235c94b2966 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:35.888192 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8c05c4dd-c008-48fc-8647-7fcb909e80a6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:35.888640 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8c05c4dd-c008-48fc-8647-7fcb909e80a6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:35.889447 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8c05c4dd-c008-48fc-8647-7fcb909e80a6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:35.889880 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8c05c4dd-c008-48fc-8647-7fcb909e80a6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:35.892720 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e046fbf9-e41d-460d-9a7e-2235c94b2966 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:35.893183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e046fbf9-e41d-460d-9a7e-2235c94b2966 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:35.893957 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e046fbf9-e41d-460d-9a7e-2235c94b2966 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:35.894395 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e046fbf9-e41d-460d-9a7e-2235c94b2966 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:36.096238 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8c05c4dd-c008-48fc-8647-7fcb909e80a6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:36.101496 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e046fbf9-e41d-460d-9a7e-2235c94b2966 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:36.105541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8c05c4dd-c008-48fc-8647-7fcb909e80a6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1558 microversion: 2.1 time: 0.229772 May 12 14:35:36.106988 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 271/529] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:35 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1558 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:35:36.112177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e046fbf9-e41d-460d-9a7e-2235c94b2966 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.230642 May 12 14:35:36.112856 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-173b47c9-a738-4fdd-be23-1438d1087fab tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:36.113020 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 259/530] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:35 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:35:36.113839 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-173b47c9-a738-4fdd-be23-1438d1087fab tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:36.120601 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-173b47c9-a738-4fdd-be23-1438d1087fab tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:36.121055 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-173b47c9-a738-4fdd-be23-1438d1087fab tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:36.122998 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-173b47c9-a738-4fdd-be23-1438d1087fab tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:36.123541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-173b47c9-a738-4fdd-be23-1438d1087fab tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:36.267525 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-173b47c9-a738-4fdd-be23-1438d1087fab tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:36.275974 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-173b47c9-a738-4fdd-be23-1438d1087fab tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:36.277515 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-173b47c9-a738-4fdd-be23-1438d1087fab tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:36.278720 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-173b47c9-a738-4fdd-be23-1438d1087fab tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1743 microversion: 2.20 time: 0.170541 May 12 14:35:36.279634 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 272/531] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:36 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:36.371640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8089510d-3f7b-4c5a-8076-8f5fbdc78450 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:36.372249 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8089510d-3f7b-4c5a-8076-8f5fbdc78450 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:36.378994 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8089510d-3f7b-4c5a-8076-8f5fbdc78450 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:36.379534 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8089510d-3f7b-4c5a-8076-8f5fbdc78450 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:36.380309 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8089510d-3f7b-4c5a-8076-8f5fbdc78450 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:36.380798 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8089510d-3f7b-4c5a-8076-8f5fbdc78450 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:36.528043 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8089510d-3f7b-4c5a-8076-8f5fbdc78450 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:36.535255 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8089510d-3f7b-4c5a-8076-8f5fbdc78450 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.167466 May 12 14:35:36.535825 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 260/532] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:36 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:37.122349 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b6b2e31e-ed05-4d0e-91c5-53567fd6c20e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:37.122990 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b6b2e31e-ed05-4d0e-91c5-53567fd6c20e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:37.129617 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-69227324-121d-4e3e-b16d-fdf20bc8cccc tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:37.130139 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b6b2e31e-ed05-4d0e-91c5-53567fd6c20e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:37.130240 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b6b2e31e-ed05-4d0e-91c5-53567fd6c20e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:37.130328 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-69227324-121d-4e3e-b16d-fdf20bc8cccc tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:37.130970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b6b2e31e-ed05-4d0e-91c5-53567fd6c20e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:37.131432 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b6b2e31e-ed05-4d0e-91c5-53567fd6c20e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:37.136795 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-69227324-121d-4e3e-b16d-fdf20bc8cccc tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:37.137248 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-69227324-121d-4e3e-b16d-fdf20bc8cccc tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:37.138038 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-69227324-121d-4e3e-b16d-fdf20bc8cccc tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:37.138478 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-69227324-121d-4e3e-b16d-fdf20bc8cccc tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:37.329262 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b6b2e31e-ed05-4d0e-91c5-53567fd6c20e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:37.336720 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b6b2e31e-ed05-4d0e-91c5-53567fd6c20e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1512 microversion: 2.1 time: 0.218154 May 12 14:35:37.337300 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 273/533] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:37 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1512 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:37.341789 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d45110a4-6c1c-4e5c-ae53-523dda597fdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:37.342396 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d45110a4-6c1c-4e5c-ae53-523dda597fdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:37.343519 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-69227324-121d-4e3e-b16d-fdf20bc8cccc tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:37.349485 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d45110a4-6c1c-4e5c-ae53-523dda597fdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:37.349941 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d45110a4-6c1c-4e5c-ae53-523dda597fdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:37.350731 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d45110a4-6c1c-4e5c-ae53-523dda597fdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:37.351192 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d45110a4-6c1c-4e5c-ae53-523dda597fdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:37.351881 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-69227324-121d-4e3e-b16d-fdf20bc8cccc tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.226471 May 12 14:35:37.352462 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 261/534] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:37 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:35:37.483670 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d45110a4-6c1c-4e5c-ae53-523dda597fdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:37.492058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d45110a4-6c1c-4e5c-ae53-523dda597fdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:37.493810 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d45110a4-6c1c-4e5c-ae53-523dda597fdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:37.494909 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d45110a4-6c1c-4e5c-ae53-523dda597fdb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1743 microversion: 2.20 time: 0.156695 May 12 14:35:37.495515 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 274/535] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:37 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:37.552454 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3aa9c03d-e8af-462c-8355-a566ddf48fcc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:37.553089 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3aa9c03d-e8af-462c-8355-a566ddf48fcc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:37.566507 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3aa9c03d-e8af-462c-8355-a566ddf48fcc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:37.566963 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3aa9c03d-e8af-462c-8355-a566ddf48fcc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:37.567768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3aa9c03d-e8af-462c-8355-a566ddf48fcc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:37.568206 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3aa9c03d-e8af-462c-8355-a566ddf48fcc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:37.709482 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3aa9c03d-e8af-462c-8355-a566ddf48fcc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:37.717146 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3aa9c03d-e8af-462c-8355-a566ddf48fcc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.168471 May 12 14:35:37.717729 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 262/536] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:37 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:38.353368 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-03fee354-796e-41bc-ac2a-e09097c35e0d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:38.354087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-03fee354-796e-41bc-ac2a-e09097c35e0d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:38.360953 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-03fee354-796e-41bc-ac2a-e09097c35e0d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:38.361392 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-03fee354-796e-41bc-ac2a-e09097c35e0d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:38.362163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-03fee354-796e-41bc-ac2a-e09097c35e0d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:38.362596 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-03fee354-796e-41bc-ac2a-e09097c35e0d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:38.373004 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8f8696bb-c87d-488a-836d-91dca4a02f26 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:38.373697 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8f8696bb-c87d-488a-836d-91dca4a02f26 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:38.381019 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8f8696bb-c87d-488a-836d-91dca4a02f26 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:38.381466 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8f8696bb-c87d-488a-836d-91dca4a02f26 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:38.382367 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8f8696bb-c87d-488a-836d-91dca4a02f26 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:38.382804 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8f8696bb-c87d-488a-836d-91dca4a02f26 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:38.559833 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-03fee354-796e-41bc-ac2a-e09097c35e0d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:38.568083 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-03fee354-796e-41bc-ac2a-e09097c35e0d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1512 microversion: 2.1 time: 0.218532 May 12 14:35:38.577980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 275/537] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:38 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:38.578296 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8f8696bb-c87d-488a-836d-91dca4a02f26 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:38.578452 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d2df89ab-7c07-4a90-acf4-cf5e5d78c9fd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:38.578452 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d2df89ab-7c07-4a90-acf4-cf5e5d78c9fd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:38.581753 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8f8696bb-c87d-488a-836d-91dca4a02f26 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.212904 May 12 14:35:38.582334 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 263/538] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:38 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:35:38.583125 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d2df89ab-7c07-4a90-acf4-cf5e5d78c9fd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:38.583587 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d2df89ab-7c07-4a90-acf4-cf5e5d78c9fd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:38.584388 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d2df89ab-7c07-4a90-acf4-cf5e5d78c9fd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:38.584844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d2df89ab-7c07-4a90-acf4-cf5e5d78c9fd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:38.734213 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2559932c-1e0f-4456-bf9f-6c7d791dec20 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:38.735729 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2559932c-1e0f-4456-bf9f-6c7d791dec20 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:38.736763 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d2df89ab-7c07-4a90-acf4-cf5e5d78c9fd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:38.743001 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2559932c-1e0f-4456-bf9f-6c7d791dec20 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:38.743588 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2559932c-1e0f-4456-bf9f-6c7d791dec20 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:38.744581 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2559932c-1e0f-4456-bf9f-6c7d791dec20 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:38.745093 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2559932c-1e0f-4456-bf9f-6c7d791dec20 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:38.745282 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d2df89ab-7c07-4a90-acf4-cf5e5d78c9fd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:38.746961 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d2df89ab-7c07-4a90-acf4-cf5e5d78c9fd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:38.748391 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d2df89ab-7c07-4a90-acf4-cf5e5d78c9fd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1743 microversion: 2.20 time: 0.178094 May 12 14:35:38.755311 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 276/539] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:38 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:38.877750 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2559932c-1e0f-4456-bf9f-6c7d791dec20 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:38.885436 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2559932c-1e0f-4456-bf9f-6c7d791dec20 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.155513 May 12 14:35:38.886095 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 264/540] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:38 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:39.585744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-22921ee5-49e1-4cc9-8abb-1366b2797bed tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:39.586370 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-22921ee5-49e1-4cc9-8abb-1366b2797bed tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:39.592858 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-22921ee5-49e1-4cc9-8abb-1366b2797bed tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:39.593320 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-22921ee5-49e1-4cc9-8abb-1366b2797bed tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:39.594115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-22921ee5-49e1-4cc9-8abb-1366b2797bed tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:39.594567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-22921ee5-49e1-4cc9-8abb-1366b2797bed tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:39.598118 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-42f76bbc-9651-410b-a64a-96f4f9140917 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:39.598736 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-42f76bbc-9651-410b-a64a-96f4f9140917 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:39.605216 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-42f76bbc-9651-410b-a64a-96f4f9140917 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:39.605664 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-42f76bbc-9651-410b-a64a-96f4f9140917 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:39.606442 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-42f76bbc-9651-410b-a64a-96f4f9140917 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:39.606874 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-42f76bbc-9651-410b-a64a-96f4f9140917 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:39.787705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-22921ee5-49e1-4cc9-8abb-1366b2797bed tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:39.795146 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-22921ee5-49e1-4cc9-8abb-1366b2797bed tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1512 microversion: 2.1 time: 0.213187 May 12 14:35:39.795738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 277/541] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:39 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1512 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:39.800490 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-fcfa8e8c-a7c7-458e-a088-fb3e3cc8c55a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:39.801114 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-fcfa8e8c-a7c7-458e-a088-fb3e3cc8c55a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:39.802400 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-42f76bbc-9651-410b-a64a-96f4f9140917 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:39.807340 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fcfa8e8c-a7c7-458e-a088-fb3e3cc8c55a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:39.807796 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fcfa8e8c-a7c7-458e-a088-fb3e3cc8c55a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:39.808588 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fcfa8e8c-a7c7-458e-a088-fb3e3cc8c55a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:39.809023 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fcfa8e8c-a7c7-458e-a088-fb3e3cc8c55a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:39.810838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-42f76bbc-9651-410b-a64a-96f4f9140917 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.216535 May 12 14:35:39.811651 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 265/542] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:39 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:35:39.905518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a8452b09-b768-45d6-bce6-d2f05128d92d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:39.906233 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a8452b09-b768-45d6-bce6-d2f05128d92d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:39.912422 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8452b09-b768-45d6-bce6-d2f05128d92d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:39.912971 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8452b09-b768-45d6-bce6-d2f05128d92d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:39.913861 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8452b09-b768-45d6-bce6-d2f05128d92d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:39.914370 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8452b09-b768-45d6-bce6-d2f05128d92d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:39.950881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-fcfa8e8c-a7c7-458e-a088-fb3e3cc8c55a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:39.961097 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-fcfa8e8c-a7c7-458e-a088-fb3e3cc8c55a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:39.962631 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-fcfa8e8c-a7c7-458e-a088-fb3e3cc8c55a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:39.963869 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-fcfa8e8c-a7c7-458e-a088-fb3e3cc8c55a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1738 microversion: 2.20 time: 0.167197 May 12 14:35:39.964651 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 278/543] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:39 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:40.061361 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a8452b09-b768-45d6-bce6-d2f05128d92d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:40.081677 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a8452b09-b768-45d6-bce6-d2f05128d92d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1503 microversion: 2.1 time: 0.170362 May 12 14:35:40.081677 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 266/544] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:39 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:35:40.092529 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-dd16603c-fca9-4694-b50b-c84e0047bb44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d06d104-605e-4593-96fd-3a027f462337"}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:35:40.094295 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-dd16603c-fca9-4694-b50b-c84e0047bb44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:40.102901 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dd16603c-fca9-4694-b50b-c84e0047bb44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:40.103452 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dd16603c-fca9-4694-b50b-c84e0047bb44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:40.104248 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dd16603c-fca9-4694-b50b-c84e0047bb44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:40.104685 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dd16603c-fca9-4694-b50b-c84e0047bb44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:40.129541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-dd16603c-fca9-4694-b50b-c84e0047bb44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] HTTP exception thrown: Cannot 'attach_volume' instance 5c5ced7e-9d8b-4d24-a35d-876326b483ba while it is in vm_state rescued May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-dd16603c-fca9-4694-b50b-c84e0047bb44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Request method failure captured: May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: POST /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba/os-volume_attachments HTTP/1.1 May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 74 May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRq0uWuP3TVHlLteeytECkdY1IHk4Hm4jgv2EqCnNnd6d7UG3PWB-NuAqkTLkf0WOJPkE44_BXmJ11jpUpyyW5sLjohov-DKwiXHfMHAMPjixk4n1DyvIkCubo7puSPwFp_XC3lYOHR3XN9hdOa8f44jvM5ppqXDZozdTAyrt_DDmpY May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 3c83c8fa2cd44eab84cb50b3ad06a1d3 May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1594015429 May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:35:40.131268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:35:40.133136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3c83c8fa2cd44eab84cb50b3ad06a1d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c83c8fa2cd44eab84cb50b3ad06a1d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3c83c8fa2cd44eab84cb50b3ad06a1d3", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c83c8fa2cd44eab84cb50b3ad06a1d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:35:40.133136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1594015429 May 12 14:35:40.133136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 3c83c8fa2cd44eab84cb50b3ad06a1d3 May 12 14:35:40.133136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1594015429 May 12 14:35:40.133136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-ServerRescueNegativeTestJSON-1594015429-project May 12 14:35:40.133136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:35:40.133136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:35:40.133136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: 2cfa47f1da4e4ae9a358e2b8ace795ac May 12 14:35:40.133136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1594015429-project May 12 14:35:40.133136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: May 12 14:35:40.133136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {"volumeAttachment": {"volumeId": "4d06d104-605e-4593-96fd-3a027f462337"}} May 12 14:35:40.133136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Cannot 'attach_volume' instance 5c5ced7e-9d8b-4d24-a35d-876326b483ba while it is in vm_state rescued May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'server_id': '5c5ced7e-9d8b-4d24-a35d-876326b483ba', 'body': {'volumeAttachment': {'volumeId': '4d06d104-605e-4593-96fd-3a027f462337'}}} May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5c5ced7e-9d8b-4d24-a35d-876326b483ba in vm_state rescued. Cannot attach_volume while the instance is in this state. May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:35:40.134058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5c5ced7e-9d8b-4d24-a35d-876326b483ba while it is in vm_state rescued May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:35:40.136876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:35:40.139574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:35:40.139574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:35:40.139574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5c5ced7e-9d8b-4d24-a35d-876326b483ba while it is in vm_state rescued May 12 14:35:40.139574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:35:40.139574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-dd16603c-fca9-4694-b50b-c84e0047bb44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Returning 409 to user: Cannot 'attach_volume' instance 5c5ced7e-9d8b-4d24-a35d-876326b483ba while it is in vm_state rescued {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:35:40.139574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-dd16603c-fca9-4694-b50b-c84e0047bb44 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "POST /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047534 May 12 14:35:40.139574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 279/545] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 12 14:35:40 2022] POST /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 14:35:40.143907 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9d366209-8714-4275-802e-8e0679d433b6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:35:40.144454 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9d366209-8714-4275-802e-8e0679d433b6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:40.154408 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9d366209-8714-4275-802e-8e0679d433b6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:40.154770 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9d366209-8714-4275-802e-8e0679d433b6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:40.155588 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9d366209-8714-4275-802e-8e0679d433b6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:40.156030 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9d366209-8714-4275-802e-8e0679d433b6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:40.244717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9d366209-8714-4275-802e-8e0679d433b6 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "POST /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba/action" status: 202 len: 0 microversion: 2.1 time: 0.104676 May 12 14:35:40.249029 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 267/546] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 12 14:35:40 2022] POST /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:35:40.256613 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3f61723c-d29a-4082-805f-94c2491c42f1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:40.257247 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3f61723c-d29a-4082-805f-94c2491c42f1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:40.263978 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3f61723c-d29a-4082-805f-94c2491c42f1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:40.264466 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3f61723c-d29a-4082-805f-94c2491c42f1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:40.265254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3f61723c-d29a-4082-805f-94c2491c42f1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:40.265715 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3f61723c-d29a-4082-805f-94c2491c42f1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:40.693750 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3f61723c-d29a-4082-805f-94c2491c42f1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:40.703186 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3f61723c-d29a-4082-805f-94c2491c42f1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1511 microversion: 2.1 time: 0.450960 May 12 14:35:40.704079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 280/547] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:40 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1511 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:40.813590 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-58ed41b7-1195-4732-84c0-b07bfcf39ade tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:40.814882 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-58ed41b7-1195-4732-84c0-b07bfcf39ade tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:40.831470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7ec2ecde-bc85-4c27-b6c1-d8572f3727f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:40.832248 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7ec2ecde-bc85-4c27-b6c1-d8572f3727f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:40.836936 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-58ed41b7-1195-4732-84c0-b07bfcf39ade tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:40.837572 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-58ed41b7-1195-4732-84c0-b07bfcf39ade tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:40.838929 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-58ed41b7-1195-4732-84c0-b07bfcf39ade tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:40.839215 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ec2ecde-bc85-4c27-b6c1-d8572f3727f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:40.839807 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ec2ecde-bc85-4c27-b6c1-d8572f3727f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:40.840572 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-58ed41b7-1195-4732-84c0-b07bfcf39ade tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:40.840984 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ec2ecde-bc85-4c27-b6c1-d8572f3727f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:40.843921 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ec2ecde-bc85-4c27-b6c1-d8572f3727f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:41.668699 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-58ed41b7-1195-4732-84c0-b07bfcf39ade tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:41.678084 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-58ed41b7-1195-4732-84c0-b07bfcf39ade tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1512 microversion: 2.1 time: 0.869236 May 12 14:35:41.680205 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7ec2ecde-bc85-4c27-b6c1-d8572f3727f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:41.688921 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7ec2ecde-bc85-4c27-b6c1-d8572f3727f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.863438 May 12 14:35:41.689476 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 268/548] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:40 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1512 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:41.693105 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 281/549] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:40 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:41.697198 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4f35be9c-4b0f-42b5-a126-62ac2c9894f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:41.698471 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4f35be9c-4b0f-42b5-a126-62ac2c9894f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:41.707434 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4f35be9c-4b0f-42b5-a126-62ac2c9894f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:41.707888 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4f35be9c-4b0f-42b5-a126-62ac2c9894f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:41.708687 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4f35be9c-4b0f-42b5-a126-62ac2c9894f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:41.709256 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4f35be9c-4b0f-42b5-a126-62ac2c9894f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:41.722751 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-5d888db7-6344-444e-b6a0-73b27cbb1106 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:41.726191 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-5d888db7-6344-444e-b6a0-73b27cbb1106 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:41.736877 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5d888db7-6344-444e-b6a0-73b27cbb1106 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:41.739316 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5d888db7-6344-444e-b6a0-73b27cbb1106 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:41.744027 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5d888db7-6344-444e-b6a0-73b27cbb1106 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:41.745777 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5d888db7-6344-444e-b6a0-73b27cbb1106 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:42.056220 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-5d888db7-6344-444e-b6a0-73b27cbb1106 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:42.060953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4f35be9c-4b0f-42b5-a126-62ac2c9894f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:42.066282 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-5d888db7-6344-444e-b6a0-73b27cbb1106 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1511 microversion: 2.1 time: 0.347912 May 12 14:35:42.078198 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 282/550] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:41 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:35:42.082126 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4f35be9c-4b0f-42b5-a126-62ac2c9894f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:42.083561 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-2d69ac6c-62f0-47fb-ba1d-7c8e496f9377 req-5666d275-26be-474a-8d37-0f0625b2f3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0d59a6-8822-4d8d-83c9-390537c9818a", "name": "network-vif-deleted", "tag": "03346ca6-97d2-422d-8314-1e57b404e30b"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:35:42.084389 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4f35be9c-4b0f-42b5-a126-62ac2c9894f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:42.085871 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4f35be9c-4b0f-42b5-a126-62ac2c9894f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1738 microversion: 2.20 time: 0.395269 May 12 14:35:42.086451 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 269/551] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:41 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1738 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:42.092693 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-2d69ac6c-62f0-47fb-ba1d-7c8e496f9377 req-5666d275-26be-474a-8d37-0f0625b2f3f2 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:42.093426 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-2d69ac6c-62f0-47fb-ba1d-7c8e496f9377 req-5666d275-26be-474a-8d37-0f0625b2f3f2 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:42.112121 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-2d69ac6c-62f0-47fb-ba1d-7c8e496f9377 req-5666d275-26be-474a-8d37-0f0625b2f3f2 service nova] Creating event network-vif-deleted:03346ca6-97d2-422d-8314-1e57b404e30b for instance 7f0d59a6-8822-4d8d-83c9-390537c9818a on hv-cinder-77703 May 12 14:35:42.117073 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-2d69ac6c-62f0-47fb-ba1d-7c8e496f9377 req-5666d275-26be-474a-8d37-0f0625b2f3f2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037373 May 12 14:35:42.117672 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 283/552] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:35:42.696520 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bcac2ac9-9e9b-4d9e-b3db-9dcf77bc8f48 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:42.697141 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bcac2ac9-9e9b-4d9e-b3db-9dcf77bc8f48 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:42.711284 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1aff8e64-7797-4bae-a8e1-ecc5f8c0b218 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:42.712312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1aff8e64-7797-4bae-a8e1-ecc5f8c0b218 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:42.721547 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bcac2ac9-9e9b-4d9e-b3db-9dcf77bc8f48 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:42.726699 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1aff8e64-7797-4bae-a8e1-ecc5f8c0b218 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:42.731270 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bcac2ac9-9e9b-4d9e-b3db-9dcf77bc8f48 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:42.732048 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bcac2ac9-9e9b-4d9e-b3db-9dcf77bc8f48 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:42.732522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bcac2ac9-9e9b-4d9e-b3db-9dcf77bc8f48 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:42.735534 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1aff8e64-7797-4bae-a8e1-ecc5f8c0b218 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:42.741682 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1aff8e64-7797-4bae-a8e1-ecc5f8c0b218 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:42.744189 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1aff8e64-7797-4bae-a8e1-ecc5f8c0b218 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:42.809534 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bcac2ac9-9e9b-4d9e-b3db-9dcf77bc8f48 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:42.810313 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bcac2ac9-9e9b-4d9e-b3db-9dcf77bc8f48 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:42.811539 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-bcac2ac9-9e9b-4d9e-b3db-9dcf77bc8f48 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lazy-loading 'fault' on Instance uuid 7f0d59a6-8822-4d8d-83c9-390537c9818a {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:35:42.889850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bcac2ac9-9e9b-4d9e-b3db-9dcf77bc8f48 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:42.909458 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bcac2ac9-9e9b-4d9e-b3db-9dcf77bc8f48 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1308 microversion: 2.1 time: 0.216010 May 12 14:35:42.911634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 270/553] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:42 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1308 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:43.002574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1aff8e64-7797-4bae-a8e1-ecc5f8c0b218 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:43.011054 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1aff8e64-7797-4bae-a8e1-ecc5f8c0b218 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.304704 May 12 14:35:43.012118 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 284/554] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:42 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:43.089189 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8fdd50d8-558e-42bd-9749-87c9f7e51156 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:43.090919 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8fdd50d8-558e-42bd-9749-87c9f7e51156 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:43.099524 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8fdd50d8-558e-42bd-9749-87c9f7e51156 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:43.100802 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8fdd50d8-558e-42bd-9749-87c9f7e51156 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:43.105042 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8fdd50d8-558e-42bd-9749-87c9f7e51156 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:43.105817 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8fdd50d8-558e-42bd-9749-87c9f7e51156 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:43.111074 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1ee2718f-3320-4610-91c7-2d72b1fe066d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:43.112216 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1ee2718f-3320-4610-91c7-2d72b1fe066d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:43.129138 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ee2718f-3320-4610-91c7-2d72b1fe066d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:43.129888 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ee2718f-3320-4610-91c7-2d72b1fe066d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:43.132094 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ee2718f-3320-4610-91c7-2d72b1fe066d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:43.132870 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ee2718f-3320-4610-91c7-2d72b1fe066d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:43.373837 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8fdd50d8-558e-42bd-9749-87c9f7e51156 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:43.383651 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8fdd50d8-558e-42bd-9749-87c9f7e51156 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1511 microversion: 2.1 time: 0.301907 May 12 14:35:43.384265 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 271/555] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:43 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:43.411316 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1ee2718f-3320-4610-91c7-2d72b1fe066d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:43.419824 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1ee2718f-3320-4610-91c7-2d72b1fe066d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:43.421353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1ee2718f-3320-4610-91c7-2d72b1fe066d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:43.423124 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1ee2718f-3320-4610-91c7-2d72b1fe066d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1738 microversion: 2.20 time: 0.318284 May 12 14:35:43.434463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 285/556] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:43 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1738 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:43.942394 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a155c9ce-d919-41b0-86ed-c4f63b8d1e9b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:43.942394 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a155c9ce-d919-41b0-86ed-c4f63b8d1e9b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:43.943813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a155c9ce-d919-41b0-86ed-c4f63b8d1e9b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:43.944276 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a155c9ce-d919-41b0-86ed-c4f63b8d1e9b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:43.945067 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a155c9ce-d919-41b0-86ed-c4f63b8d1e9b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:43.945517 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a155c9ce-d919-41b0-86ed-c4f63b8d1e9b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:43.986627 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a155c9ce-d919-41b0-86ed-c4f63b8d1e9b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:43.987424 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a155c9ce-d919-41b0-86ed-c4f63b8d1e9b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:43.988028 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-a155c9ce-d919-41b0-86ed-c4f63b8d1e9b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lazy-loading 'fault' on Instance uuid 7f0d59a6-8822-4d8d-83c9-390537c9818a {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:35:44.032823 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-afa1e56a-44f4-4b40-a815-a98d0af79acf tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:44.034155 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-afa1e56a-44f4-4b40-a815-a98d0af79acf tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:44.037562 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a155c9ce-d919-41b0-86ed-c4f63b8d1e9b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:44.041600 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-afa1e56a-44f4-4b40-a815-a98d0af79acf tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:44.042324 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-afa1e56a-44f4-4b40-a815-a98d0af79acf tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:44.043410 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-afa1e56a-44f4-4b40-a815-a98d0af79acf tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:44.044012 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-afa1e56a-44f4-4b40-a815-a98d0af79acf tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:44.045861 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a155c9ce-d919-41b0-86ed-c4f63b8d1e9b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1308 microversion: 2.1 time: 0.113926 May 12 14:35:44.056483 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 272/557] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:43 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:44.210262 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-afa1e56a-44f4-4b40-a815-a98d0af79acf tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:44.218566 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-afa1e56a-44f4-4b40-a815-a98d0af79acf tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.192288 May 12 14:35:44.219937 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 286/558] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:44 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:44.406803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1fcdc012-626d-46a1-9123-d0eae84d44c4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:44.407469 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1fcdc012-626d-46a1-9123-d0eae84d44c4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:44.414580 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1fcdc012-626d-46a1-9123-d0eae84d44c4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:44.415062 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1fcdc012-626d-46a1-9123-d0eae84d44c4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:44.416088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1fcdc012-626d-46a1-9123-d0eae84d44c4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:44.416608 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1fcdc012-626d-46a1-9123-d0eae84d44c4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:44.442181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8457b8d3-94ca-4e28-be01-2fa794b986bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:44.443379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-8457b8d3-94ca-4e28-be01-2fa794b986bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:44.450113 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8457b8d3-94ca-4e28-be01-2fa794b986bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:44.450912 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8457b8d3-94ca-4e28-be01-2fa794b986bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:44.452160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8457b8d3-94ca-4e28-be01-2fa794b986bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:44.452681 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8457b8d3-94ca-4e28-be01-2fa794b986bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:44.683878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8457b8d3-94ca-4e28-be01-2fa794b986bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:44.686040 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1fcdc012-626d-46a1-9123-d0eae84d44c4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:44.695858 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1fcdc012-626d-46a1-9123-d0eae84d44c4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1511 microversion: 2.1 time: 0.293296 May 12 14:35:44.704366 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8457b8d3-94ca-4e28-be01-2fa794b986bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:44.708179 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8457b8d3-94ca-4e28-be01-2fa794b986bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:44.709676 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 273/559] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:44 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:44.710505 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8457b8d3-94ca-4e28-be01-2fa794b986bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1738 microversion: 2.20 time: 0.272573 May 12 14:35:44.711530 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 287/560] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:44 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:45.067813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-623ec789-de38-4ecb-9cd9-34095df4dbf6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:45.069291 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-623ec789-de38-4ecb-9cd9-34095df4dbf6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:45.081788 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-623ec789-de38-4ecb-9cd9-34095df4dbf6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:45.083006 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-623ec789-de38-4ecb-9cd9-34095df4dbf6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:45.084870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-623ec789-de38-4ecb-9cd9-34095df4dbf6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:45.085880 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-623ec789-de38-4ecb-9cd9-34095df4dbf6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:45.144109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-623ec789-de38-4ecb-9cd9-34095df4dbf6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:45.144943 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-623ec789-de38-4ecb-9cd9-34095df4dbf6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:45.145707 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-623ec789-de38-4ecb-9cd9-34095df4dbf6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lazy-loading 'fault' on Instance uuid 7f0d59a6-8822-4d8d-83c9-390537c9818a {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:35:45.196578 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-623ec789-de38-4ecb-9cd9-34095df4dbf6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:45.204707 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-623ec789-de38-4ecb-9cd9-34095df4dbf6 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 200 len: 1308 microversion: 2.1 time: 0.144204 May 12 14:35:45.205344 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 274/561] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:45 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 1308 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:45.237036 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9debbb30-e1fe-4a49-99e1-57a6638a210f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:45.237735 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9debbb30-e1fe-4a49-99e1-57a6638a210f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:45.244628 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9debbb30-e1fe-4a49-99e1-57a6638a210f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:45.245079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9debbb30-e1fe-4a49-99e1-57a6638a210f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:45.250844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9debbb30-e1fe-4a49-99e1-57a6638a210f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:45.250844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9debbb30-e1fe-4a49-99e1-57a6638a210f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:45.405604 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9debbb30-e1fe-4a49-99e1-57a6638a210f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:45.413811 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9debbb30-e1fe-4a49-99e1-57a6638a210f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.181199 May 12 14:35:45.414827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 288/562] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:45 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:45.730920 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-93342979-39ff-43b2-89bf-83faddf5f508 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:45.731404 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3a203ef7-1306-4d41-832f-bf4aec827a56 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:45.732864 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3a203ef7-1306-4d41-832f-bf4aec827a56 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:45.735135 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-93342979-39ff-43b2-89bf-83faddf5f508 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:45.761254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93342979-39ff-43b2-89bf-83faddf5f508 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:45.762668 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3a203ef7-1306-4d41-832f-bf4aec827a56 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:45.763636 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3a203ef7-1306-4d41-832f-bf4aec827a56 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:45.764020 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93342979-39ff-43b2-89bf-83faddf5f508 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:45.766303 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93342979-39ff-43b2-89bf-83faddf5f508 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:45.767539 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3a203ef7-1306-4d41-832f-bf4aec827a56 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:45.769572 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3a203ef7-1306-4d41-832f-bf4aec827a56 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:45.770741 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93342979-39ff-43b2-89bf-83faddf5f508 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:46.036587 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3a203ef7-1306-4d41-832f-bf4aec827a56 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:46.053854 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3a203ef7-1306-4d41-832f-bf4aec827a56 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1511 microversion: 2.1 time: 0.340911 May 12 14:35:46.067793 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 275/563] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:45 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1511 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:46.075809 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-93342979-39ff-43b2-89bf-83faddf5f508 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:46.083881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-93342979-39ff-43b2-89bf-83faddf5f508 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:46.085424 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-93342979-39ff-43b2-89bf-83faddf5f508 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:46.087018 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-93342979-39ff-43b2-89bf-83faddf5f508 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1738 microversion: 2.20 time: 0.359802 May 12 14:35:46.088225 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 289/564] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:45 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1738 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:46.221690 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b7e81fc2-3431-47e4-80fe-8a543ab154c8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:46.222725 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b7e81fc2-3431-47e4-80fe-8a543ab154c8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 7f0d59a6-8822-4d8d-83c9-390537c9818a] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:46.229762 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b7e81fc2-3431-47e4-80fe-8a543ab154c8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:46.230226 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b7e81fc2-3431-47e4-80fe-8a543ab154c8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:46.231024 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b7e81fc2-3431-47e4-80fe-8a543ab154c8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:46.231676 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b7e81fc2-3431-47e4-80fe-8a543ab154c8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:46.248660 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-b7e81fc2-3431-47e4-80fe-8a543ab154c8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] HTTP exception thrown: Instance 7f0d59a6-8822-4d8d-83c9-390537c9818a could not be found. May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b7e81fc2-3431-47e4-80fe-8a543ab154c8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Request method failure captured: May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a HTTP/1.1 May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRqsWAEGZuxoA-K0Y3vTihgfklS0yybGiIsXvVk6XA5PwDj_2ys0ol7c81R681FyH-HhHGyGJDqovmIj1P02GWCk-YXwIaasAx7zc8T7NKZyXbHG5xpQ5W3xzRsCYv_a9zof1VsgjbQD8-NksyDl_z55nYyxya_VOfeeZ1xsTW239pk May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: a9501c41f0664eca9177e0071bb5b1b8 May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1036433163 May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:35:46.250786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:35:46.252728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a9501c41f0664eca9177e0071bb5b1b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9501c41f0664eca9177e0071bb5b1b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a9501c41f0664eca9177e0071bb5b1b8", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9501c41f0664eca9177e0071bb5b1b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:35:46.252728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-VolumesSnapshotTestJSON-1036433163 May 12 14:35:46.252728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: a9501c41f0664eca9177e0071bb5b1b8 May 12 14:35:46.252728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1036433163 May 12 14:35:46.252728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-VolumesSnapshotTestJSON-1036433163-project May 12 14:35:46.252728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:35:46.252728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:35:46.252728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: e6fa3252d9f04964b481dd02b378d072 May 12 14:35:46.252728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-VolumesSnapshotTestJSON-1036433163-project May 12 14:35:46.252728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:35:46.252728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance 7f0d59a6-8822-4d8d-83c9-390537c9818a could not be found. May 12 14:35:46.252728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': '7f0d59a6-8822-4d8d-83c9-390537c9818a'} May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f0d59a6-8822-4d8d-83c9-390537c9818a could not be found. May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:35:46.253518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0d59a6-8822-4d8d-83c9-390537c9818a could not be found. May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0d59a6-8822-4d8d-83c9-390537c9818a could not be found. May 12 14:35:46.254764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:35:46.255965 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b7e81fc2-3431-47e4-80fe-8a543ab154c8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Returning 404 to user: Instance 7f0d59a6-8822-4d8d-83c9-390537c9818a could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:35:46.255965 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b7e81fc2-3431-47e4-80fe-8a543ab154c8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a" status: 404 len: 111 microversion: 2.1 time: 0.035235 May 12 14:35:46.264858 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 276/565] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:46 2022] GET /compute/v2.1/servers/7f0d59a6-8822-4d8d-83c9-390537c9818a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:35:46.447781 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8bc7e57c-af74-4479-ba8e-0ded92394b29 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:46.449795 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-8bc7e57c-af74-4479-ba8e-0ded92394b29 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:46.465512 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8bc7e57c-af74-4479-ba8e-0ded92394b29 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:46.467283 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8bc7e57c-af74-4479-ba8e-0ded92394b29 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:46.469382 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8bc7e57c-af74-4479-ba8e-0ded92394b29 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:46.472581 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8bc7e57c-af74-4479-ba8e-0ded92394b29 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:46.667593 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8bc7e57c-af74-4479-ba8e-0ded92394b29 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:46.686268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8bc7e57c-af74-4479-ba8e-0ded92394b29 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.258338 May 12 14:35:46.687723 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 290/566] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:46 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:47.078122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-068024a3-0b95-41d6-a47f-07168fe9e51e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:47.079438 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-068024a3-0b95-41d6-a47f-07168fe9e51e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:47.085922 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-068024a3-0b95-41d6-a47f-07168fe9e51e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:47.086699 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-068024a3-0b95-41d6-a47f-07168fe9e51e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:47.087751 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-068024a3-0b95-41d6-a47f-07168fe9e51e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:47.088206 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-068024a3-0b95-41d6-a47f-07168fe9e51e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:47.108937 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6f3cae78-e4ee-471f-a088-efb98e439941 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:47.109971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6f3cae78-e4ee-471f-a088-efb98e439941 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:47.116627 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6f3cae78-e4ee-471f-a088-efb98e439941 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:47.117241 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6f3cae78-e4ee-471f-a088-efb98e439941 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:47.118201 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6f3cae78-e4ee-471f-a088-efb98e439941 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:47.118875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6f3cae78-e4ee-471f-a088-efb98e439941 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:47.318230 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-068024a3-0b95-41d6-a47f-07168fe9e51e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:47.327324 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-068024a3-0b95-41d6-a47f-07168fe9e51e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1517 microversion: 2.1 time: 0.253619 May 12 14:35:47.340958 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 277/567] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:47 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1517 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:47.349613 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6f3cae78-e4ee-471f-a088-efb98e439941 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:47.361276 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6f3cae78-e4ee-471f-a088-efb98e439941 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:47.362888 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6f3cae78-e4ee-471f-a088-efb98e439941 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:47.365256 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6f3cae78-e4ee-471f-a088-efb98e439941 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1738 microversion: 2.20 time: 0.260048 May 12 14:35:47.380916 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 291/568] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:47 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:47.709079 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ba174e55-578a-45aa-ad8c-910fc997df85 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:47.710135 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ba174e55-578a-45aa-ad8c-910fc997df85 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:47.729365 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ba174e55-578a-45aa-ad8c-910fc997df85 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:47.729872 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ba174e55-578a-45aa-ad8c-910fc997df85 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:47.730691 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ba174e55-578a-45aa-ad8c-910fc997df85 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:47.731170 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ba174e55-578a-45aa-ad8c-910fc997df85 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:47.924584 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ba174e55-578a-45aa-ad8c-910fc997df85 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:47.939591 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ba174e55-578a-45aa-ad8c-910fc997df85 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.238887 May 12 14:35:47.949631 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 278/569] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:47 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:48.396411 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-5c515027-6500-453a-b302-23be2c36d420 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:48.398603 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-5c515027-6500-453a-b302-23be2c36d420 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:48.408109 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5c515027-6500-453a-b302-23be2c36d420 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:48.409266 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5c515027-6500-453a-b302-23be2c36d420 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:48.410864 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5c515027-6500-453a-b302-23be2c36d420 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:48.411708 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5c515027-6500-453a-b302-23be2c36d420 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:48.569307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-5c515027-6500-453a-b302-23be2c36d420 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:48.577782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-5c515027-6500-453a-b302-23be2c36d420 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:48.579404 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-5c515027-6500-453a-b302-23be2c36d420 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:48.580614 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-5c515027-6500-453a-b302-23be2c36d420 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1738 microversion: 2.20 time: 0.192367 May 12 14:35:48.581193 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 292/570] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:48 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:48.973365 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-6c348454-1b97-4fe6-a9ae-13eb684b9a8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:48.974202 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-6c348454-1b97-4fe6-a9ae-13eb684b9a8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:48.981354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6c348454-1b97-4fe6-a9ae-13eb684b9a8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:48.981678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6c348454-1b97-4fe6-a9ae-13eb684b9a8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:48.982480 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6c348454-1b97-4fe6-a9ae-13eb684b9a8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:48.983142 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6c348454-1b97-4fe6-a9ae-13eb684b9a8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:49.141282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-6c348454-1b97-4fe6-a9ae-13eb684b9a8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:49.151080 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-6c348454-1b97-4fe6-a9ae-13eb684b9a8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.193994 May 12 14:35:49.151080 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 279/571] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:48 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:49.630736 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-512639d9-fe67-4854-8120-fb5665cb57ec tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:49.637448 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-512639d9-fe67-4854-8120-fb5665cb57ec tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:49.653389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-512639d9-fe67-4854-8120-fb5665cb57ec tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:49.653886 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-512639d9-fe67-4854-8120-fb5665cb57ec tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:49.654830 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-512639d9-fe67-4854-8120-fb5665cb57ec tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:49.655319 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-512639d9-fe67-4854-8120-fb5665cb57ec tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:49.828706 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-512639d9-fe67-4854-8120-fb5665cb57ec tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:49.840064 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-512639d9-fe67-4854-8120-fb5665cb57ec tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:49.840064 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-512639d9-fe67-4854-8120-fb5665cb57ec tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:49.841719 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-512639d9-fe67-4854-8120-fb5665cb57ec tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1738 microversion: 2.20 time: 0.242198 May 12 14:35:49.842527 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 293/572] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:49 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:50.172143 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f027211e-7321-4a92-aec7-e4171d25b2bd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:50.172788 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f027211e-7321-4a92-aec7-e4171d25b2bd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:50.184653 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f027211e-7321-4a92-aec7-e4171d25b2bd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:50.185287 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f027211e-7321-4a92-aec7-e4171d25b2bd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:50.194573 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f027211e-7321-4a92-aec7-e4171d25b2bd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:50.194573 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f027211e-7321-4a92-aec7-e4171d25b2bd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:50.358767 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f027211e-7321-4a92-aec7-e4171d25b2bd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:50.368401 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f027211e-7321-4a92-aec7-e4171d25b2bd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.200891 May 12 14:35:50.369429 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 280/573] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:50 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:35:50.862502 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-889262a0-2a99-44df-ae35-2265eb497eb6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:50.863399 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-889262a0-2a99-44df-ae35-2265eb497eb6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:50.871417 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-889262a0-2a99-44df-ae35-2265eb497eb6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:50.872323 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-889262a0-2a99-44df-ae35-2265eb497eb6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:50.873662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-889262a0-2a99-44df-ae35-2265eb497eb6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:50.874291 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-889262a0-2a99-44df-ae35-2265eb497eb6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:51.026454 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-889262a0-2a99-44df-ae35-2265eb497eb6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:51.037580 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-889262a0-2a99-44df-ae35-2265eb497eb6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:51.039386 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-889262a0-2a99-44df-ae35-2265eb497eb6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:51.040589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-889262a0-2a99-44df-ae35-2265eb497eb6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1738 microversion: 2.20 time: 0.182562 May 12 14:35:51.041072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 294/574] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:50 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:35:51.388566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2e828993-497a-4c3e-8c66-cdf748bac091 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:51.389213 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2e828993-497a-4c3e-8c66-cdf748bac091 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:51.395959 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2e828993-497a-4c3e-8c66-cdf748bac091 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:51.396414 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2e828993-497a-4c3e-8c66-cdf748bac091 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:51.397197 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2e828993-497a-4c3e-8c66-cdf748bac091 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:51.397631 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2e828993-497a-4c3e-8c66-cdf748bac091 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:51.541176 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2e828993-497a-4c3e-8c66-cdf748bac091 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:51.549423 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2e828993-497a-4c3e-8c66-cdf748bac091 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.164662 May 12 14:35:51.550016 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 281/575] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:51 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:52.059428 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2c04ca3b-e70b-453e-870c-65a98596116c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:52.060049 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2c04ca3b-e70b-453e-870c-65a98596116c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:52.066510 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c04ca3b-e70b-453e-870c-65a98596116c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:52.066959 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c04ca3b-e70b-453e-870c-65a98596116c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:52.067787 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c04ca3b-e70b-453e-870c-65a98596116c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:52.068213 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c04ca3b-e70b-453e-870c-65a98596116c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:52.201762 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2c04ca3b-e70b-453e-870c-65a98596116c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:52.212917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2c04ca3b-e70b-453e-870c-65a98596116c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:52.214439 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2c04ca3b-e70b-453e-870c-65a98596116c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:52.215713 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2c04ca3b-e70b-453e-870c-65a98596116c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1738 microversion: 2.20 time: 0.160302 May 12 14:35:52.216280 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 295/576] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:52 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:52.566266 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-524f2eb8-f28e-4673-9d13-93bec3ccaf57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:52.566804 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-524f2eb8-f28e-4673-9d13-93bec3ccaf57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:52.573377 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-524f2eb8-f28e-4673-9d13-93bec3ccaf57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:52.574050 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-524f2eb8-f28e-4673-9d13-93bec3ccaf57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:52.574836 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-524f2eb8-f28e-4673-9d13-93bec3ccaf57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:52.575306 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-524f2eb8-f28e-4673-9d13-93bec3ccaf57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:52.711112 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-524f2eb8-f28e-4673-9d13-93bec3ccaf57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:52.720387 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-524f2eb8-f28e-4673-9d13-93bec3ccaf57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.158213 May 12 14:35:52.720956 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 282/577] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:52 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:53.162221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f025363b-2f6e-41d1-837c-9798a2266e3e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Action: 'create', calling method: .version_select at 0x7f5b262140d0>, body: {"keypair": {"name": "tempest-keypair-2024683558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLm4Uwye4r80CKNoMZ54b6y+kvIRhjtffSkanAWQ/BVTWtEQC5JqzXA/QPJloXZ5rO/+X1bi8Bi7bcR/gh+wQVU6yOR/K1KPVjcSXVyGYnuNa1yRxr2w9mJqKwFdBkKYA=="}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:35:53.176977 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-f025363b-2f6e-41d1-837c-9798a2266e3e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Getting quotas for project 3c83c8fa2cd44eab84cb50b3ad06a1d3. Resources: {'key_pairs'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:35:53.181731 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-f025363b-2f6e-41d1-837c-9798a2266e3e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Getting quotas for user 2cfa47f1da4e4ae9a358e2b8ace795ac and project 3c83c8fa2cd44eab84cb50b3ad06a1d3. Resources: {'key_pairs'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:35:53.204111 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f025363b-2f6e-41d1-837c-9798a2266e3e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045693 May 12 14:35:53.204726 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 296/578] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 12 14:35:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:35:53.235698 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-22a4be6d-d5d3-49f2-aa32-c4650bf0c6a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:53.236494 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-22a4be6d-d5d3-49f2-aa32-c4650bf0c6a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:53.244576 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-22a4be6d-d5d3-49f2-aa32-c4650bf0c6a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:53.245191 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-22a4be6d-d5d3-49f2-aa32-c4650bf0c6a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:53.246248 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-22a4be6d-d5d3-49f2-aa32-c4650bf0c6a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:53.247066 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-22a4be6d-d5d3-49f2-aa32-c4650bf0c6a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:53.422264 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-22a4be6d-d5d3-49f2-aa32-c4650bf0c6a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:53.430366 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-22a4be6d-d5d3-49f2-aa32-c4650bf0c6a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:53.431899 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-22a4be6d-d5d3-49f2-aa32-c4650bf0c6a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:53.433067 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-22a4be6d-d5d3-49f2-aa32-c4650bf0c6a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1738 microversion: 2.20 time: 0.202675 May 12 14:35:53.433634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 283/579] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:53 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:53.739229 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c0d360eb-fc28-49b4-93bf-797c2848ab58 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:53.739884 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c0d360eb-fc28-49b4-93bf-797c2848ab58 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:53.746099 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c0d360eb-fc28-49b4-93bf-797c2848ab58 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:53.746555 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c0d360eb-fc28-49b4-93bf-797c2848ab58 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:53.747378 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c0d360eb-fc28-49b4-93bf-797c2848ab58 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:53.747817 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c0d360eb-fc28-49b4-93bf-797c2848ab58 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:53.969999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c0d360eb-fc28-49b4-93bf-797c2848ab58 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:53.979079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c0d360eb-fc28-49b4-93bf-797c2848ab58 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.243398 May 12 14:35:53.991956 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 297/580] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:53 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:54.454902 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-03ecc847-9213-4233-ab9c-c6989e3308c4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:54.455729 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-03ecc847-9213-4233-ab9c-c6989e3308c4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:54.464506 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-03ecc847-9213-4233-ab9c-c6989e3308c4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:54.465277 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-03ecc847-9213-4233-ab9c-c6989e3308c4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:54.466260 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-03ecc847-9213-4233-ab9c-c6989e3308c4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:54.466688 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-03ecc847-9213-4233-ab9c-c6989e3308c4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:54.763642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-03ecc847-9213-4233-ab9c-c6989e3308c4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:54.773694 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-03ecc847-9213-4233-ab9c-c6989e3308c4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:54.775349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-03ecc847-9213-4233-ab9c-c6989e3308c4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:54.776605 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-03ecc847-9213-4233-ab9c-c6989e3308c4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1720 microversion: 2.20 time: 0.329331 May 12 14:35:54.777247 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 284/581] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:54 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1720 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:54.811172 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1954831552", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a960421c-0ac7-4777-ad11-86ea1221dbd0"}], "security_groups": [{"name": "tempest-securitygroup--348030222"}], "key_name": "tempest-keypair-2024683558", "user_data": "}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:35:54.958617 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.network.neutron [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] validate_networks() for [('a960421c-0ac7-4777-ad11-86ea1221dbd0', None, None, None, None, None)] {{(pid=118216) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:35:55.055083 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2df20754-250f-46bf-91de-18bc533440c5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:55.055760 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2df20754-250f-46bf-91de-18bc533440c5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:55.061819 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2df20754-250f-46bf-91de-18bc533440c5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:55.062282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2df20754-250f-46bf-91de-18bc533440c5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:55.063103 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2df20754-250f-46bf-91de-18bc533440c5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:55.063549 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2df20754-250f-46bf-91de-18bc533440c5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:55.291723 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2df20754-250f-46bf-91de-18bc533440c5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:55.299485 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2df20754-250f-46bf-91de-18bc533440c5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.248276 May 12 14:35:55.300080 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 285/582] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:55 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:35:55.470813 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Flavor limits 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:35:55.471211 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Image limits 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:35:55.471697 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Flavor pref 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:35:55.472194 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Image pref 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:35:55.472559 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:35:55.481583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:55.482023 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:55.482903 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:55.483371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:55.501261 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Getting quotas for project 3c83c8fa2cd44eab84cb50b3ad06a1d3. Resources: {'cores', 'instances', 'ram'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:35:55.505341 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Getting quotas for user 2cfa47f1da4e4ae9a358e2b8ace795ac and project 3c83c8fa2cd44eab84cb50b3ad06a1d3. Resources: {'cores', 'instances', 'ram'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:35:55.517071 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Going to run 1 instances... {{(pid=118216) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:35:55.519378 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:35:55.566644 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4ce752c9-503b-403f-9e33-a36eea384efb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.759668 May 12 14:35:55.567266 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 298/583] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:35:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:35:55.577416 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-630c79d0-0670-4d8c-a9ae-33c92cce3e61 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:55.578631 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-630c79d0-0670-4d8c-a9ae-33c92cce3e61 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:55.642560 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-630c79d0-0670-4d8c-a9ae-33c92cce3e61 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:55.649415 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-630c79d0-0670-4d8c-a9ae-33c92cce3e61 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1246 microversion: 2.1 time: 0.075887 May 12 14:35:55.650214 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 286/584] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:55 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1246 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:55.795839 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-72643150-c2d0-4e27-9284-536faf691919 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:55.796969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-72643150-c2d0-4e27-9284-536faf691919 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:55.803612 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-72643150-c2d0-4e27-9284-536faf691919 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:55.804073 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-72643150-c2d0-4e27-9284-536faf691919 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:55.804858 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-72643150-c2d0-4e27-9284-536faf691919 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:55.805305 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-72643150-c2d0-4e27-9284-536faf691919 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:55.954714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-72643150-c2d0-4e27-9284-536faf691919 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:55.963430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-72643150-c2d0-4e27-9284-536faf691919 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:55.965083 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-72643150-c2d0-4e27-9284-536faf691919 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:55.966411 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-72643150-c2d0-4e27-9284-536faf691919 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1720 microversion: 2.20 time: 0.175177 May 12 14:35:55.967316 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 299/585] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:55 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:56.317009 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-27130b85-2fb0-4f65-b7ca-f004b69397f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:56.317693 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-27130b85-2fb0-4f65-b7ca-f004b69397f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:56.324066 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-27130b85-2fb0-4f65-b7ca-f004b69397f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:56.324522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-27130b85-2fb0-4f65-b7ca-f004b69397f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:56.325296 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-27130b85-2fb0-4f65-b7ca-f004b69397f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:56.325731 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-27130b85-2fb0-4f65-b7ca-f004b69397f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:56.467859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-27130b85-2fb0-4f65-b7ca-f004b69397f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:56.478663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-27130b85-2fb0-4f65-b7ca-f004b69397f4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.165617 May 12 14:35:56.479302 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 287/586] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:56 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:56.666314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-fc6da6c4-334d-4ca3-913c-17841912f28e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:56.666930 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-fc6da6c4-334d-4ca3-913c-17841912f28e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:56.673020 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fc6da6c4-334d-4ca3-913c-17841912f28e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:56.673475 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fc6da6c4-334d-4ca3-913c-17841912f28e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:56.674261 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fc6da6c4-334d-4ca3-913c-17841912f28e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:56.674699 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fc6da6c4-334d-4ca3-913c-17841912f28e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:56.744491 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-fc6da6c4-334d-4ca3-913c-17841912f28e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:56.752111 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-fc6da6c4-334d-4ca3-913c-17841912f28e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1250 microversion: 2.1 time: 0.089645 May 12 14:35:56.752805 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 300/587] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:56 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1250 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:56.984852 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1cb056a4-72df-4398-9617-9df40d04c8a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:56.985490 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1cb056a4-72df-4398-9617-9df40d04c8a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:56.992028 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1cb056a4-72df-4398-9617-9df40d04c8a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:56.992393 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1cb056a4-72df-4398-9617-9df40d04c8a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:56.993172 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1cb056a4-72df-4398-9617-9df40d04c8a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:56.993643 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1cb056a4-72df-4398-9617-9df40d04c8a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:57.122059 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1cb056a4-72df-4398-9617-9df40d04c8a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:57.131059 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1cb056a4-72df-4398-9617-9df40d04c8a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:57.132575 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1cb056a4-72df-4398-9617-9df40d04c8a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:57.133815 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1cb056a4-72df-4398-9617-9df40d04c8a5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1720 microversion: 2.20 time: 0.152816 May 12 14:35:57.134384 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 288/588] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:56 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:57.495825 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9799c9b0-de6a-41cc-833e-a23d22d9e6c3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:57.496475 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9799c9b0-de6a-41cc-833e-a23d22d9e6c3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:57.503521 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9799c9b0-de6a-41cc-833e-a23d22d9e6c3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:57.503976 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9799c9b0-de6a-41cc-833e-a23d22d9e6c3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:57.504758 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9799c9b0-de6a-41cc-833e-a23d22d9e6c3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:57.505199 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9799c9b0-de6a-41cc-833e-a23d22d9e6c3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:57.637479 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9799c9b0-de6a-41cc-833e-a23d22d9e6c3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:57.645250 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9799c9b0-de6a-41cc-833e-a23d22d9e6c3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.153295 May 12 14:35:57.645832 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 301/589] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:57 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:57.769115 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-eeafbd65-0e5e-4e70-80d9-92bab65c7349 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:57.769642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-eeafbd65-0e5e-4e70-80d9-92bab65c7349 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:57.775641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-eeafbd65-0e5e-4e70-80d9-92bab65c7349 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:57.776097 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-eeafbd65-0e5e-4e70-80d9-92bab65c7349 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:57.776859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-eeafbd65-0e5e-4e70-80d9-92bab65c7349 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:57.777303 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-eeafbd65-0e5e-4e70-80d9-92bab65c7349 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:57.839841 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-eeafbd65-0e5e-4e70-80d9-92bab65c7349 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:57.852087 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-eeafbd65-0e5e-4e70-80d9-92bab65c7349 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1250 microversion: 2.1 time: 0.086815 May 12 14:35:57.852685 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 289/590] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:57 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1250 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:58.153497 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0a757b8b-ba08-4cc0-a365-1c0a3d505294 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:58.154103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0a757b8b-ba08-4cc0-a365-1c0a3d505294 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:58.160653 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0a757b8b-ba08-4cc0-a365-1c0a3d505294 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:58.161102 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0a757b8b-ba08-4cc0-a365-1c0a3d505294 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:58.161874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0a757b8b-ba08-4cc0-a365-1c0a3d505294 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:58.162352 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0a757b8b-ba08-4cc0-a365-1c0a3d505294 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:58.294944 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0a757b8b-ba08-4cc0-a365-1c0a3d505294 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:58.302712 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0a757b8b-ba08-4cc0-a365-1c0a3d505294 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:58.304239 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0a757b8b-ba08-4cc0-a365-1c0a3d505294 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:58.305382 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0a757b8b-ba08-4cc0-a365-1c0a3d505294 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1720 microversion: 2.20 time: 0.155868 May 12 14:35:58.305946 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 302/591] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:58 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:58.661655 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ce6edd8a-84aa-4fd6-a1f0-eb279d0bde84 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:58.662261 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ce6edd8a-84aa-4fd6-a1f0-eb279d0bde84 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:58.669847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ce6edd8a-84aa-4fd6-a1f0-eb279d0bde84 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:58.670318 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ce6edd8a-84aa-4fd6-a1f0-eb279d0bde84 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:58.671158 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ce6edd8a-84aa-4fd6-a1f0-eb279d0bde84 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:58.672210 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ce6edd8a-84aa-4fd6-a1f0-eb279d0bde84 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:58.806447 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ce6edd8a-84aa-4fd6-a1f0-eb279d0bde84 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:58.813904 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ce6edd8a-84aa-4fd6-a1f0-eb279d0bde84 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.156072 May 12 14:35:58.814486 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 290/592] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:58 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:58.868798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-857e516a-ae85-47e4-8b9b-11374c9caf3c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:58.869406 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-857e516a-ae85-47e4-8b9b-11374c9caf3c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:58.876076 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-857e516a-ae85-47e4-8b9b-11374c9caf3c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:58.876541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-857e516a-ae85-47e4-8b9b-11374c9caf3c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:58.877322 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-857e516a-ae85-47e4-8b9b-11374c9caf3c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:58.877767 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-857e516a-ae85-47e4-8b9b-11374c9caf3c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:58.937633 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-857e516a-ae85-47e4-8b9b-11374c9caf3c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:58.944926 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-857e516a-ae85-47e4-8b9b-11374c9caf3c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1242 microversion: 2.1 time: 0.079917 May 12 14:35:58.945496 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 303/593] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:58 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:35:59.323863 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f6341efd-469f-4806-8cc1-dd75f6e5caa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:59.324482 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f6341efd-469f-4806-8cc1-dd75f6e5caa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:59.331569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f6341efd-469f-4806-8cc1-dd75f6e5caa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:59.332038 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f6341efd-469f-4806-8cc1-dd75f6e5caa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:59.332818 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f6341efd-469f-4806-8cc1-dd75f6e5caa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:59.333263 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f6341efd-469f-4806-8cc1-dd75f6e5caa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:59.381919 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-615780604", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "networks": [{"uuid": "c4e4c52c-dcb8-4f29-b913-b6c0c789c55d"}]}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:35:59.433063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.network.neutron [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] validate_networks() for [('c4e4c52c-dcb8-4f29-b913-b6c0c789c55d', None, None, None, None, None)] {{(pid=118216) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:35:59.728230 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f6341efd-469f-4806-8cc1-dd75f6e5caa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:59.737340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f6341efd-469f-4806-8cc1-dd75f6e5caa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:59.738871 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f6341efd-469f-4806-8cc1-dd75f6e5caa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:35:59.740109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f6341efd-469f-4806-8cc1-dd75f6e5caa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1720 microversion: 2.20 time: 0.420075 May 12 14:35:59.740690 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 291/594] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:35:59 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1720 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:35:59.745903 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-08bb7afd-2b02-4421-a82a-e8992c53a30e req-0fa55b8d-6deb-41dc-84a2-891404faf34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e2a4c2-6255-4074-9a3c-e5159c3f7b87", "name": "network-vif-unplugged", "status": "completed", "tag": "7fccb52d-a09a-4e64-adbe-8b42348d39c5"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:35:59.755690 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-08bb7afd-2b02-4421-a82a-e8992c53a30e req-0fa55b8d-6deb-41dc-84a2-891404faf34c service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:59.756139 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-08bb7afd-2b02-4421-a82a-e8992c53a30e req-0fa55b8d-6deb-41dc-84a2-891404faf34c service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:59.768250 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-08bb7afd-2b02-4421-a82a-e8992c53a30e req-0fa55b8d-6deb-41dc-84a2-891404faf34c service nova] Creating event network-vif-unplugged:7fccb52d-a09a-4e64-adbe-8b42348d39c5 for instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 on hv-cinder-77703 May 12 14:35:59.773836 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-08bb7afd-2b02-4421-a82a-e8992c53a30e req-0fa55b8d-6deb-41dc-84a2-891404faf34c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031366 May 12 14:35:59.774451 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 292/595] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:35:59.830672 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b80c8f09-973c-404e-858a-5fe108e93c31 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:35:59.831453 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b80c8f09-973c-404e-858a-5fe108e93c31 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:35:59.838006 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b80c8f09-973c-404e-858a-5fe108e93c31 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:59.838460 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b80c8f09-973c-404e-858a-5fe108e93c31 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:35:59.839271 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b80c8f09-973c-404e-858a-5fe108e93c31 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:35:59.839713 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b80c8f09-973c-404e-858a-5fe108e93c31 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:00.057571 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b80c8f09-973c-404e-858a-5fe108e93c31 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:00.064999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b80c8f09-973c-404e-858a-5fe108e93c31 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.238565 May 12 14:36:00.065669 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 293/596] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:35:59 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:00.070187 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4ef1367d-5901-4798-b275-8269de424886 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:00.070870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4ef1367d-5901-4798-b275-8269de424886 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:00.076757 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4ef1367d-5901-4798-b275-8269de424886 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:00.077290 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4ef1367d-5901-4798-b275-8269de424886 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:00.078067 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4ef1367d-5901-4798-b275-8269de424886 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:00.078510 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4ef1367d-5901-4798-b275-8269de424886 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:00.125459 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Flavor limits 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:36:00.125941 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Image limits 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:36:00.126354 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Flavor pref 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:36:00.126767 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Image pref 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:36:00.127213 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:36:00.136799 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:00.137257 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:00.138064 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:00.138514 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:00.141048 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4ef1367d-5901-4798-b275-8269de424886 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:00.148364 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4ef1367d-5901-4798-b275-8269de424886 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1242 microversion: 2.1 time: 0.081650 May 12 14:36:00.148952 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 294/597] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:00 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:00.155239 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Getting quotas for project a9501c41f0664eca9177e0071bb5b1b8. Resources: {'cores', 'instances', 'ram'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:36:00.159556 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Getting quotas for user e6fa3252d9f04964b481dd02b378d072 and project a9501c41f0664eca9177e0071bb5b1b8. Resources: {'cores', 'instances', 'ram'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:36:00.170266 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Going to run 1 instances... {{(pid=118216) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:36:00.173005 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:36:00.218094 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ae15a37e-ff65-486c-ab4b-34bc23fa384e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839964 May 12 14:36:00.219295 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 304/598] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:35:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 14:36:00.229009 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c83bc5c4-c52b-49ca-9115-11072162f03a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:00.229626 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c83bc5c4-c52b-49ca-9115-11072162f03a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:00.282181 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c83bc5c4-c52b-49ca-9115-11072162f03a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:00.288705 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c83bc5c4-c52b-49ca-9115-11072162f03a tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1218 microversion: 2.1 time: 0.063463 May 12 14:36:00.289290 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 295/599] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:00 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:00.759469 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-617e64ab-4725-4001-a6ea-67eece30b199 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:00.760080 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-617e64ab-4725-4001-a6ea-67eece30b199 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:00.766159 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-617e64ab-4725-4001-a6ea-67eece30b199 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:00.766604 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-617e64ab-4725-4001-a6ea-67eece30b199 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:00.767398 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-617e64ab-4725-4001-a6ea-67eece30b199 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:00.767832 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-617e64ab-4725-4001-a6ea-67eece30b199 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:00.899761 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-617e64ab-4725-4001-a6ea-67eece30b199 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:00.908338 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-617e64ab-4725-4001-a6ea-67eece30b199 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:00.909869 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-617e64ab-4725-4001-a6ea-67eece30b199 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:00.911083 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-617e64ab-4725-4001-a6ea-67eece30b199 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1720 microversion: 2.20 time: 0.155640 May 12 14:36:00.911706 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 305/600] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:00 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:01.083732 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-23df84b8-69da-4611-967c-32f5f54eb4b9 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:01.084740 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-23df84b8-69da-4611-967c-32f5f54eb4b9 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:01.100792 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-23df84b8-69da-4611-967c-32f5f54eb4b9 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:01.101163 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-23df84b8-69da-4611-967c-32f5f54eb4b9 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:01.101952 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-23df84b8-69da-4611-967c-32f5f54eb4b9 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:01.102394 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-23df84b8-69da-4611-967c-32f5f54eb4b9 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:01.167929 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-635fcd1a-4f42-4949-a909-84e1676040d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:01.168554 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-635fcd1a-4f42-4949-a909-84e1676040d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:01.175489 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-635fcd1a-4f42-4949-a909-84e1676040d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:01.175988 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-635fcd1a-4f42-4949-a909-84e1676040d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:01.176796 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-635fcd1a-4f42-4949-a909-84e1676040d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:01.177242 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-635fcd1a-4f42-4949-a909-84e1676040d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:01.246843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-635fcd1a-4f42-4949-a909-84e1676040d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:01.255214 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-635fcd1a-4f42-4949-a909-84e1676040d0 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1298 microversion: 2.1 time: 0.092340 May 12 14:36:01.255810 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 306/601] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:01 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:01.275678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-23df84b8-69da-4611-967c-32f5f54eb4b9 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:01.282886 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-23df84b8-69da-4611-967c-32f5f54eb4b9 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.204244 May 12 14:36:01.283496 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 296/602] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:01 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:01.305302 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d3deef49-0088-4711-beff-05976ae8c740 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:01.305917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d3deef49-0088-4711-beff-05976ae8c740 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:01.312558 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d3deef49-0088-4711-beff-05976ae8c740 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:01.313011 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d3deef49-0088-4711-beff-05976ae8c740 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:01.313790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d3deef49-0088-4711-beff-05976ae8c740 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:01.314227 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d3deef49-0088-4711-beff-05976ae8c740 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:01.379131 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d3deef49-0088-4711-beff-05976ae8c740 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:01.386453 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d3deef49-0088-4711-beff-05976ae8c740 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1270 microversion: 2.1 time: 0.084943 May 12 14:36:01.387037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 307/603] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:01 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:01.875580 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-3307476d-8432-4d73-8cea-d4c3f3ec9ca6 req-5136bcfa-775a-4786-9ae0-460564001b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef", "name": "network-vif-plugged", "status": "completed", "tag": "228c90b8-3a08-410b-be25-ba639362a959"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:36:01.885153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-3307476d-8432-4d73-8cea-d4c3f3ec9ca6 req-5136bcfa-775a-4786-9ae0-460564001b5b service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:01.885947 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-3307476d-8432-4d73-8cea-d4c3f3ec9ca6 req-5136bcfa-775a-4786-9ae0-460564001b5b service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:01.898170 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-3307476d-8432-4d73-8cea-d4c3f3ec9ca6 req-5136bcfa-775a-4786-9ae0-460564001b5b service nova] Creating event network-vif-plugged:228c90b8-3a08-410b-be25-ba639362a959 for instance ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef on hv-cinder-77703 May 12 14:36:01.903484 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-3307476d-8432-4d73-8cea-d4c3f3ec9ca6 req-5136bcfa-775a-4786-9ae0-460564001b5b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031940 May 12 14:36:01.904089 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 297/604] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:36:01.929626 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-285a26b6-0a13-4929-8051-2ca1b91b66dc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:01.930165 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-285a26b6-0a13-4929-8051-2ca1b91b66dc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:01.936794 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-285a26b6-0a13-4929-8051-2ca1b91b66dc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:01.937256 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-285a26b6-0a13-4929-8051-2ca1b91b66dc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:01.938093 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-285a26b6-0a13-4929-8051-2ca1b91b66dc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:01.938535 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-285a26b6-0a13-4929-8051-2ca1b91b66dc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:02.150848 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-285a26b6-0a13-4929-8051-2ca1b91b66dc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:02.159196 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-285a26b6-0a13-4929-8051-2ca1b91b66dc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:02.160746 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-285a26b6-0a13-4929-8051-2ca1b91b66dc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:02.161940 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-285a26b6-0a13-4929-8051-2ca1b91b66dc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1723 microversion: 2.20 time: 0.236297 May 12 14:36:02.162497 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 308/605] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:01 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:02.180845 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-05324a97-2c95-4d2f-9888-354f14555f82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed9d2580-4f14-49ba-8a5a-eca41ae39038"}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:36:02.181935 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-05324a97-2c95-4d2f-9888-354f14555f82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:02.188809 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-05324a97-2c95-4d2f-9888-354f14555f82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:02.189262 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-05324a97-2c95-4d2f-9888-354f14555f82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:02.190061 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-05324a97-2c95-4d2f-9888-354f14555f82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:02.190498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-05324a97-2c95-4d2f-9888-354f14555f82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:02.272232 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-52bdddac-865c-4550-85fe-2708949017fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:02.272982 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-52bdddac-865c-4550-85fe-2708949017fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:02.278956 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-52bdddac-865c-4550-85fe-2708949017fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:02.279434 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-52bdddac-865c-4550-85fe-2708949017fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:02.280213 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-52bdddac-865c-4550-85fe-2708949017fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:02.280658 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-52bdddac-865c-4550-85fe-2708949017fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:02.346464 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-52bdddac-865c-4550-85fe-2708949017fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:02.354969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-52bdddac-865c-4550-85fe-2708949017fa tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1304 microversion: 2.1 time: 0.086710 May 12 14:36:02.355586 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 309/606] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:02 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1304 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:02.360614 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8aab0a39-95e3-4948-88c7-474ed86043c4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:02.361234 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-8aab0a39-95e3-4948-88c7-474ed86043c4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:02.367883 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8aab0a39-95e3-4948-88c7-474ed86043c4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:02.368370 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8aab0a39-95e3-4948-88c7-474ed86043c4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:02.369417 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8aab0a39-95e3-4948-88c7-474ed86043c4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:02.369977 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8aab0a39-95e3-4948-88c7-474ed86043c4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:02.569836 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-05324a97-2c95-4d2f-9888-354f14555f82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "POST /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.393796 May 12 14:36:02.570619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 298/607] 10.222.0.75 () {62 vars in 1363 bytes} [Thu May 12 14:36:02 2022] POST /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments => generated 188 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:36:02.585525 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-65e3b383-5904-47cc-89c4-820cae348723 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:02.586197 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-65e3b383-5904-47cc-89c4-820cae348723 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:02.598393 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-65e3b383-5904-47cc-89c4-820cae348723 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:02.599100 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-65e3b383-5904-47cc-89c4-820cae348723 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:02.599678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-65e3b383-5904-47cc-89c4-820cae348723 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:02.600125 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-65e3b383-5904-47cc-89c4-820cae348723 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:02.667556 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8aab0a39-95e3-4948-88c7-474ed86043c4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:02.676296 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8aab0a39-95e3-4948-88c7-474ed86043c4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.319687 May 12 14:36:02.676880 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 310/608] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:02 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:02.692948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-65e3b383-5904-47cc-89c4-820cae348723 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:02.701191 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-65e3b383-5904-47cc-89c4-820cae348723 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1288 microversion: 2.1 time: 0.128403 May 12 14:36:02.701783 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 299/609] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:02 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1288 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:02.708843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-cc5237f1-dae8-47fb-b1ea-fd06932bd249 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:36:02.709709 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-cc5237f1-dae8-47fb-b1ea-fd06932bd249 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:02.716594 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cc5237f1-dae8-47fb-b1ea-fd06932bd249 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:02.717062 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cc5237f1-dae8-47fb-b1ea-fd06932bd249 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:02.718067 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cc5237f1-dae8-47fb-b1ea-fd06932bd249 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:02.718515 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cc5237f1-dae8-47fb-b1ea-fd06932bd249 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:02.835773 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-cc5237f1-dae8-47fb-b1ea-fd06932bd249 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "POST /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/action" status: 202 len: 0 microversion: 2.20 time: 0.131144 May 12 14:36:02.837049 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 311/610] 10.222.0.75 () {62 vars in 1318 bytes} [Thu May 12 14:36:02 2022] POST /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:36:02.845875 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-76e39f97-4757-4c9e-8080-a19f65549e00 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:02.847431 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-76e39f97-4757-4c9e-8080-a19f65549e00 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:02.855902 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76e39f97-4757-4c9e-8080-a19f65549e00 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:02.856354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76e39f97-4757-4c9e-8080-a19f65549e00 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:02.857136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76e39f97-4757-4c9e-8080-a19f65549e00 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:02.857780 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76e39f97-4757-4c9e-8080-a19f65549e00 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:03.200700 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-76e39f97-4757-4c9e-8080-a19f65549e00 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:03.210197 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-76e39f97-4757-4c9e-8080-a19f65549e00 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:03.211748 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-76e39f97-4757-4c9e-8080-a19f65549e00 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:03.212918 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-76e39f97-4757-4c9e-8080-a19f65549e00 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1749 microversion: 2.20 time: 0.371732 May 12 14:36:03.213622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 300/611] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:02 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1749 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:03.372361 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-bed93b38-6d91-4eef-aa6e-57ecbff03df5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:03.372983 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-bed93b38-6d91-4eef-aa6e-57ecbff03df5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:03.380497 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bed93b38-6d91-4eef-aa6e-57ecbff03df5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:03.381183 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bed93b38-6d91-4eef-aa6e-57ecbff03df5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:03.382155 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bed93b38-6d91-4eef-aa6e-57ecbff03df5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:03.382796 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bed93b38-6d91-4eef-aa6e-57ecbff03df5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:03.491718 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-bed93b38-6d91-4eef-aa6e-57ecbff03df5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:03.500309 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-bed93b38-6d91-4eef-aa6e-57ecbff03df5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1304 microversion: 2.1 time: 0.132306 May 12 14:36:03.501141 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 312/612] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:03 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:03.694475 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-76e1de4d-c738-49ea-bede-5421efc9ab46 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:03.695207 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-76e1de4d-c738-49ea-bede-5421efc9ab46 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:03.701679 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76e1de4d-c738-49ea-bede-5421efc9ab46 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:03.702099 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76e1de4d-c738-49ea-bede-5421efc9ab46 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:03.702890 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76e1de4d-c738-49ea-bede-5421efc9ab46 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:03.703520 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76e1de4d-c738-49ea-bede-5421efc9ab46 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:03.719908 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-daa735b2-6962-40fd-88d1-43fdff94313b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:03.720687 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-daa735b2-6962-40fd-88d1-43fdff94313b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:03.727502 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-daa735b2-6962-40fd-88d1-43fdff94313b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:03.727951 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-daa735b2-6962-40fd-88d1-43fdff94313b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:03.728726 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-daa735b2-6962-40fd-88d1-43fdff94313b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:03.729376 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-daa735b2-6962-40fd-88d1-43fdff94313b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:04.068543 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-daa735b2-6962-40fd-88d1-43fdff94313b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:04.072942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-76e1de4d-c738-49ea-bede-5421efc9ab46 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:04.078603 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-daa735b2-6962-40fd-88d1-43fdff94313b tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1318 microversion: 2.1 time: 0.364094 May 12 14:36:04.079167 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 313/613] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:03 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:04.080868 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-76e1de4d-c738-49ea-bede-5421efc9ab46 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.391042 May 12 14:36:04.082202 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 301/614] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:03 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:04.232223 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-67d97fc1-ac23-4cc9-99e0-8213503c427f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:04.232833 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-67d97fc1-ac23-4cc9-99e0-8213503c427f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:04.238943 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-67d97fc1-ac23-4cc9-99e0-8213503c427f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:04.239464 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-67d97fc1-ac23-4cc9-99e0-8213503c427f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:04.240229 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-67d97fc1-ac23-4cc9-99e0-8213503c427f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:04.240692 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-67d97fc1-ac23-4cc9-99e0-8213503c427f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:04.364284 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-67d97fc1-ac23-4cc9-99e0-8213503c427f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:04.374034 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-67d97fc1-ac23-4cc9-99e0-8213503c427f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:04.376382 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-67d97fc1-ac23-4cc9-99e0-8213503c427f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:04.377540 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-67d97fc1-ac23-4cc9-99e0-8213503c427f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1749 microversion: 2.20 time: 0.149302 May 12 14:36:04.378100 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 314/615] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:04 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1749 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:04.518832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f518aafb-4b74-493f-8361-05896b519b43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:04.519477 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f518aafb-4b74-493f-8361-05896b519b43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:04.525922 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f518aafb-4b74-493f-8361-05896b519b43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:04.526440 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f518aafb-4b74-493f-8361-05896b519b43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:04.527241 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f518aafb-4b74-493f-8361-05896b519b43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:04.527680 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f518aafb-4b74-493f-8361-05896b519b43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:04.655950 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f518aafb-4b74-493f-8361-05896b519b43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:04.663659 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f518aafb-4b74-493f-8361-05896b519b43 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.149745 May 12 14:36:04.664228 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 302/616] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:04 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:05.096191 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0126b6d2-848d-496a-85b5-d342e06ea019 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:05.097026 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0126b6d2-848d-496a-85b5-d342e06ea019 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:05.097902 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f7def836-df03-4e36-87ef-566dd4686b64 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:05.098523 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f7def836-df03-4e36-87ef-566dd4686b64 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:05.103288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0126b6d2-848d-496a-85b5-d342e06ea019 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:05.103856 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0126b6d2-848d-496a-85b5-d342e06ea019 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:05.104493 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f7def836-df03-4e36-87ef-566dd4686b64 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:05.104827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0126b6d2-848d-496a-85b5-d342e06ea019 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:05.104931 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f7def836-df03-4e36-87ef-566dd4686b64 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:05.105453 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0126b6d2-848d-496a-85b5-d342e06ea019 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:05.105710 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f7def836-df03-4e36-87ef-566dd4686b64 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:05.106156 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f7def836-df03-4e36-87ef-566dd4686b64 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:05.465248 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0126b6d2-848d-496a-85b5-d342e06ea019 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:05.472686 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0126b6d2-848d-496a-85b5-d342e06ea019 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1318 microversion: 2.1 time: 0.380846 May 12 14:36:05.473277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 315/617] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:05 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:05.487666 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f7def836-df03-4e36-87ef-566dd4686b64 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:05.489899 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-48c35f43-d7c3-4e04-bcba-d3d469c8992e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:05.490586 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-48c35f43-d7c3-4e04-bcba-d3d469c8992e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:05.495588 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f7def836-df03-4e36-87ef-566dd4686b64 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1259 microversion: 2.1 time: 0.401373 May 12 14:36:05.496591 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 303/618] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:05 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1259 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:05.497057 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48c35f43-d7c3-4e04-bcba-d3d469c8992e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:05.497570 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48c35f43-d7c3-4e04-bcba-d3d469c8992e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:05.498411 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48c35f43-d7c3-4e04-bcba-d3d469c8992e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:05.498912 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48c35f43-d7c3-4e04-bcba-d3d469c8992e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:05.681184 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7b13fbc9-53bc-4d86-b441-8d0fc84434f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:05.682597 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7b13fbc9-53bc-4d86-b441-8d0fc84434f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:05.692862 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7b13fbc9-53bc-4d86-b441-8d0fc84434f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:05.693583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7b13fbc9-53bc-4d86-b441-8d0fc84434f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:05.694650 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7b13fbc9-53bc-4d86-b441-8d0fc84434f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:05.696751 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7b13fbc9-53bc-4d86-b441-8d0fc84434f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:06.107968 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-48c35f43-d7c3-4e04-bcba-d3d469c8992e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:06.116484 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-48c35f43-d7c3-4e04-bcba-d3d469c8992e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:06.117993 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-48c35f43-d7c3-4e04-bcba-d3d469c8992e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:06.119174 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-48c35f43-d7c3-4e04-bcba-d3d469c8992e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1751 microversion: 2.20 time: 0.644781 May 12 14:36:06.119740 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 316/619] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:05 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1751 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:06.278201 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7b13fbc9-53bc-4d86-b441-8d0fc84434f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:06.285816 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7b13fbc9-53bc-4d86-b441-8d0fc84434f8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.608947 May 12 14:36:06.286431 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 304/620] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:05 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:06.426555 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-2ce67aa3-648d-4a98-811f-5c4d9e9a20dc req-797de627-5f32-416d-8253-a64ba62181d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e40740-6dab-4657-abc3-eb83ee4b4c4d", "tag": "1d9bd042-8dc9-4559-9211-62f3a465dca4"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:36:06.436245 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-2ce67aa3-648d-4a98-811f-5c4d9e9a20dc req-797de627-5f32-416d-8253-a64ba62181d8 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:06.437412 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-2ce67aa3-648d-4a98-811f-5c4d9e9a20dc req-797de627-5f32-416d-8253-a64ba62181d8 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:06.455860 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-2ce67aa3-648d-4a98-811f-5c4d9e9a20dc req-797de627-5f32-416d-8253-a64ba62181d8 service nova] Creating event network-changed:1d9bd042-8dc9-4559-9211-62f3a465dca4 for instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d on hv-cinder-77703 May 12 14:36:06.462739 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-2ce67aa3-648d-4a98-811f-5c4d9e9a20dc req-797de627-5f32-416d-8253-a64ba62181d8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039899 May 12 14:36:06.463411 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 317/621] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:36:06.494078 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-fc9f5027-61f9-4f14-8e90-c257fa381d08 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:06.495359 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-fc9f5027-61f9-4f14-8e90-c257fa381d08 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:06.506336 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fc9f5027-61f9-4f14-8e90-c257fa381d08 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:06.510014 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fc9f5027-61f9-4f14-8e90-c257fa381d08 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:06.511759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fc9f5027-61f9-4f14-8e90-c257fa381d08 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:06.512592 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fc9f5027-61f9-4f14-8e90-c257fa381d08 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:06.528762 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9f62e72a-85a9-4f6f-af4c-91b8ccf85e3f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:06.529690 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9f62e72a-85a9-4f6f-af4c-91b8ccf85e3f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:06.537630 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f62e72a-85a9-4f6f-af4c-91b8ccf85e3f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:06.538465 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f62e72a-85a9-4f6f-af4c-91b8ccf85e3f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:06.540106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f62e72a-85a9-4f6f-af4c-91b8ccf85e3f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:06.540748 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f62e72a-85a9-4f6f-af4c-91b8ccf85e3f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:06.914284 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-fc9f5027-61f9-4f14-8e90-c257fa381d08 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:06.921896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-fc9f5027-61f9-4f14-8e90-c257fa381d08 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1318 microversion: 2.1 time: 0.431829 May 12 14:36:06.922471 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 305/622] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:06 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:06.927329 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9f62e72a-85a9-4f6f-af4c-91b8ccf85e3f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:06.935423 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9f62e72a-85a9-4f6f-af4c-91b8ccf85e3f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1444 microversion: 2.1 time: 0.423889 May 12 14:36:06.936132 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 318/623] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:06 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1444 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:06.952609 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-cb5c50e8-e887-455c-81db-6f291eea95d3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:06.953256 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-cb5c50e8-e887-455c-81db-6f291eea95d3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:06.959525 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cb5c50e8-e887-455c-81db-6f291eea95d3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:06.959980 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cb5c50e8-e887-455c-81db-6f291eea95d3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:06.960762 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cb5c50e8-e887-455c-81db-6f291eea95d3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:06.961199 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cb5c50e8-e887-455c-81db-6f291eea95d3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:07.092353 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-cb5c50e8-e887-455c-81db-6f291eea95d3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:07.099949 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-cb5c50e8-e887-455c-81db-6f291eea95d3 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1444 microversion: 2.1 time: 0.151398 May 12 14:36:07.100581 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 306/624] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:06 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:07.138743 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-90b081fe-8427-4862-b711-21304661b13c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:07.139385 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-90b081fe-8427-4862-b711-21304661b13c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:07.145396 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-90b081fe-8427-4862-b711-21304661b13c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:07.145849 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-90b081fe-8427-4862-b711-21304661b13c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:07.146626 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-90b081fe-8427-4862-b711-21304661b13c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:07.147086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-90b081fe-8427-4862-b711-21304661b13c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:07.303062 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d8f101cc-4430-4293-b62c-bf52e82d313f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:07.303718 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d8f101cc-4430-4293-b62c-bf52e82d313f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:07.309720 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d8f101cc-4430-4293-b62c-bf52e82d313f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:07.310174 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d8f101cc-4430-4293-b62c-bf52e82d313f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:07.310949 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d8f101cc-4430-4293-b62c-bf52e82d313f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:07.311424 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d8f101cc-4430-4293-b62c-bf52e82d313f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:07.668052 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-90b081fe-8427-4862-b711-21304661b13c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:07.677723 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-90b081fe-8427-4862-b711-21304661b13c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:07.679686 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-90b081fe-8427-4862-b711-21304661b13c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:07.681046 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-90b081fe-8427-4862-b711-21304661b13c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.546126 May 12 14:36:07.687102 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 319/625] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:07 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:07.851204 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d8f101cc-4430-4293-b62c-bf52e82d313f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:07.859722 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d8f101cc-4430-4293-b62c-bf52e82d313f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.560507 May 12 14:36:07.870659 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 307/626] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:07 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:07.940152 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-fa5a907a-2d20-47d7-9bd9-06f39a98afe9 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:07.940943 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-fa5a907a-2d20-47d7-9bd9-06f39a98afe9 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:07.948287 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fa5a907a-2d20-47d7-9bd9-06f39a98afe9 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:07.948739 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fa5a907a-2d20-47d7-9bd9-06f39a98afe9 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:07.949594 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fa5a907a-2d20-47d7-9bd9-06f39a98afe9 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:07.950134 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fa5a907a-2d20-47d7-9bd9-06f39a98afe9 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:08.129482 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-fa5a907a-2d20-47d7-9bd9-06f39a98afe9 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:08.137043 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-fa5a907a-2d20-47d7-9bd9-06f39a98afe9 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1318 microversion: 2.1 time: 0.201820 May 12 14:36:08.137629 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 320/627] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:07 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:08.488217 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-9c558f5c-6264-480f-a459-f92027038f8d req-301e3279-69dd-4691-96cb-2b7fa893728d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03ea87fc-19a5-4d9e-b6c3-7b464c75d052", "tag": "1a2cb385-3a41-4cfb-a347-2f9ef44bca18"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:36:08.496225 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-9c558f5c-6264-480f-a459-f92027038f8d req-301e3279-69dd-4691-96cb-2b7fa893728d service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:08.496674 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-9c558f5c-6264-480f-a459-f92027038f8d req-301e3279-69dd-4691-96cb-2b7fa893728d service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:08.509200 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-9c558f5c-6264-480f-a459-f92027038f8d req-301e3279-69dd-4691-96cb-2b7fa893728d service nova] Creating event network-changed:1a2cb385-3a41-4cfb-a347-2f9ef44bca18 for instance 03ea87fc-19a5-4d9e-b6c3-7b464c75d052 on hv-cinder-77703 May 12 14:36:08.514912 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-9c558f5c-6264-480f-a459-f92027038f8d req-301e3279-69dd-4691-96cb-2b7fa893728d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030397 May 12 14:36:08.515536 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 308/628] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:36:08.698467 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-48f5a015-4a7a-4e8e-bc39-0e6a67d09da9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:08.699256 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-48f5a015-4a7a-4e8e-bc39-0e6a67d09da9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:08.705673 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48f5a015-4a7a-4e8e-bc39-0e6a67d09da9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:08.706138 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48f5a015-4a7a-4e8e-bc39-0e6a67d09da9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:08.706955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48f5a015-4a7a-4e8e-bc39-0e6a67d09da9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:08.707425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48f5a015-4a7a-4e8e-bc39-0e6a67d09da9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:08.840044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-48f5a015-4a7a-4e8e-bc39-0e6a67d09da9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:08.849981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-48f5a015-4a7a-4e8e-bc39-0e6a67d09da9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:08.851442 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-48f5a015-4a7a-4e8e-bc39-0e6a67d09da9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:08.852936 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-48f5a015-4a7a-4e8e-bc39-0e6a67d09da9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.158088 May 12 14:36:08.853529 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 321/629] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:08 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:08.877623 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-44ef9beb-c945-43a5-a6d3-0c0f027d1867 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:08.878464 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-44ef9beb-c945-43a5-a6d3-0c0f027d1867 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:08.885762 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-44ef9beb-c945-43a5-a6d3-0c0f027d1867 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:08.886220 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-44ef9beb-c945-43a5-a6d3-0c0f027d1867 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:08.887014 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-44ef9beb-c945-43a5-a6d3-0c0f027d1867 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:08.887474 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-44ef9beb-c945-43a5-a6d3-0c0f027d1867 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:09.020564 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-44ef9beb-c945-43a5-a6d3-0c0f027d1867 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:09.028340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-44ef9beb-c945-43a5-a6d3-0c0f027d1867 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.155130 May 12 14:36:09.028934 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 309/630] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:08 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:09.153726 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8d73c0af-9dc1-4e43-baea-a0c980d21404 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:09.154351 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-8d73c0af-9dc1-4e43-baea-a0c980d21404 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:09.160739 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8d73c0af-9dc1-4e43-baea-a0c980d21404 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:09.161197 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8d73c0af-9dc1-4e43-baea-a0c980d21404 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:09.161981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8d73c0af-9dc1-4e43-baea-a0c980d21404 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:09.162457 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8d73c0af-9dc1-4e43-baea-a0c980d21404 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:09.299800 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-fddd20c5-45c6-4aa4-8087-d2eef80e30d8 req-efe4c9d7-6fe5-4f1a-bb0b-5bffb8e0004c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef", "tag": "228c90b8-3a08-410b-be25-ba639362a959"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:36:09.308466 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8d73c0af-9dc1-4e43-baea-a0c980d21404 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:09.312769 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-fddd20c5-45c6-4aa4-8087-d2eef80e30d8 req-efe4c9d7-6fe5-4f1a-bb0b-5bffb8e0004c service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:09.313215 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-fddd20c5-45c6-4aa4-8087-d2eef80e30d8 req-efe4c9d7-6fe5-4f1a-bb0b-5bffb8e0004c service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:09.316552 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8d73c0af-9dc1-4e43-baea-a0c980d21404 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1318 microversion: 2.1 time: 0.166630 May 12 14:36:09.317406 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 322/631] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:09 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:09.326024 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-fddd20c5-45c6-4aa4-8087-d2eef80e30d8 req-efe4c9d7-6fe5-4f1a-bb0b-5bffb8e0004c service nova] Creating event network-changed:228c90b8-3a08-410b-be25-ba639362a959 for instance ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef on hv-cinder-77703 May 12 14:36:09.331406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-fddd20c5-45c6-4aa4-8087-d2eef80e30d8 req-efe4c9d7-6fe5-4f1a-bb0b-5bffb8e0004c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037432 May 12 14:36:09.332286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 310/632] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:36:09.872489 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-da23bd6d-faf7-422d-94ce-f76b6b918e5a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:09.873012 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-da23bd6d-faf7-422d-94ce-f76b6b918e5a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:09.879553 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-da23bd6d-faf7-422d-94ce-f76b6b918e5a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:09.880028 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-da23bd6d-faf7-422d-94ce-f76b6b918e5a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:09.881007 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-da23bd6d-faf7-422d-94ce-f76b6b918e5a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:09.881447 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-da23bd6d-faf7-422d-94ce-f76b6b918e5a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:10.013334 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-da23bd6d-faf7-422d-94ce-f76b6b918e5a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:10.022139 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-da23bd6d-faf7-422d-94ce-f76b6b918e5a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:10.023705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-da23bd6d-faf7-422d-94ce-f76b6b918e5a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:10.024865 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-da23bd6d-faf7-422d-94ce-f76b6b918e5a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.156381 May 12 14:36:10.025424 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 323/633] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:09 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:10.046451 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-27334abc-3220-4c69-b9d4-d017f1e29067 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:10.047308 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-27334abc-3220-4c69-b9d4-d017f1e29067 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:10.053654 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-27334abc-3220-4c69-b9d4-d017f1e29067 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:10.053996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-27334abc-3220-4c69-b9d4-d017f1e29067 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:10.054771 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-27334abc-3220-4c69-b9d4-d017f1e29067 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:10.055263 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-27334abc-3220-4c69-b9d4-d017f1e29067 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:10.186743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-27334abc-3220-4c69-b9d4-d017f1e29067 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:10.195749 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-27334abc-3220-4c69-b9d4-d017f1e29067 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.154028 May 12 14:36:10.196327 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 311/634] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:10 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:10.334205 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-da8e8949-b765-4c9a-9e45-5e23eb9b8f97 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:10.334874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-da8e8949-b765-4c9a-9e45-5e23eb9b8f97 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:10.341518 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-da8e8949-b765-4c9a-9e45-5e23eb9b8f97 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:10.341979 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-da8e8949-b765-4c9a-9e45-5e23eb9b8f97 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:10.342771 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-da8e8949-b765-4c9a-9e45-5e23eb9b8f97 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:10.343248 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-da8e8949-b765-4c9a-9e45-5e23eb9b8f97 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:10.474648 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-da8e8949-b765-4c9a-9e45-5e23eb9b8f97 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:10.481881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-da8e8949-b765-4c9a-9e45-5e23eb9b8f97 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1318 microversion: 2.1 time: 0.151588 May 12 14:36:10.482451 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 324/635] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:10 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:11.043126 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8a209f3a-8f4f-41c6-8234-221b40737519 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:11.043778 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8a209f3a-8f4f-41c6-8234-221b40737519 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:11.050596 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8a209f3a-8f4f-41c6-8234-221b40737519 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:11.051165 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8a209f3a-8f4f-41c6-8234-221b40737519 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:11.051951 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8a209f3a-8f4f-41c6-8234-221b40737519 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:11.052393 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8a209f3a-8f4f-41c6-8234-221b40737519 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:11.177269 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8a209f3a-8f4f-41c6-8234-221b40737519 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:11.185663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8a209f3a-8f4f-41c6-8234-221b40737519 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:11.187188 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8a209f3a-8f4f-41c6-8234-221b40737519 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:11.188347 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8a209f3a-8f4f-41c6-8234-221b40737519 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.149158 May 12 14:36:11.188912 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 312/636] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:11 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:11.212613 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ec76295e-259b-43dd-863b-ab5f10be0055 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:11.213224 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ec76295e-259b-43dd-863b-ab5f10be0055 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:11.220072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec76295e-259b-43dd-863b-ab5f10be0055 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:11.220466 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec76295e-259b-43dd-863b-ab5f10be0055 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:11.221226 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec76295e-259b-43dd-863b-ab5f10be0055 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:11.221661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec76295e-259b-43dd-863b-ab5f10be0055 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:11.348831 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ec76295e-259b-43dd-863b-ab5f10be0055 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:11.356108 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ec76295e-259b-43dd-863b-ab5f10be0055 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.147242 May 12 14:36:11.356685 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 325/637] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:11 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:11.498137 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d96e2b6a-f630-4999-8639-18ae85840530 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:11.498675 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d96e2b6a-f630-4999-8639-18ae85840530 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:11.504778 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d96e2b6a-f630-4999-8639-18ae85840530 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:11.505233 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d96e2b6a-f630-4999-8639-18ae85840530 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:11.506001 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d96e2b6a-f630-4999-8639-18ae85840530 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:11.506440 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d96e2b6a-f630-4999-8639-18ae85840530 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:11.633746 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d96e2b6a-f630-4999-8639-18ae85840530 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:11.641677 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d96e2b6a-f630-4999-8639-18ae85840530 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1318 microversion: 2.1 time: 0.147401 May 12 14:36:11.642253 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 313/638] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:11 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:12.206525 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-13da2b43-d3a6-4285-8ec7-d47f8748010e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:12.207171 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-13da2b43-d3a6-4285-8ec7-d47f8748010e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:12.214023 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-13da2b43-d3a6-4285-8ec7-d47f8748010e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:12.214516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-13da2b43-d3a6-4285-8ec7-d47f8748010e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:12.215285 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-13da2b43-d3a6-4285-8ec7-d47f8748010e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:12.215730 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-13da2b43-d3a6-4285-8ec7-d47f8748010e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:12.340572 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-13da2b43-d3a6-4285-8ec7-d47f8748010e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:12.348870 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-13da2b43-d3a6-4285-8ec7-d47f8748010e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:12.350390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-13da2b43-d3a6-4285-8ec7-d47f8748010e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:12.351583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-13da2b43-d3a6-4285-8ec7-d47f8748010e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.149064 May 12 14:36:12.352151 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 326/639] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:12 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:12.373475 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-23e65381-f629-41f8-881b-38a033223cac tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:12.374653 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-23e65381-f629-41f8-881b-38a033223cac tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:12.381217 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-23e65381-f629-41f8-881b-38a033223cac tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:12.381667 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-23e65381-f629-41f8-881b-38a033223cac tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:12.382431 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-23e65381-f629-41f8-881b-38a033223cac tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:12.382867 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-23e65381-f629-41f8-881b-38a033223cac tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:12.518348 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-23e65381-f629-41f8-881b-38a033223cac tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:12.525520 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-23e65381-f629-41f8-881b-38a033223cac tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.155877 May 12 14:36:12.526097 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 314/640] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:12 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:12.659050 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4910227e-6f80-4ea8-91a6-b0fada745674 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:12.659662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4910227e-6f80-4ea8-91a6-b0fada745674 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:12.665942 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4910227e-6f80-4ea8-91a6-b0fada745674 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:12.666394 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4910227e-6f80-4ea8-91a6-b0fada745674 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:12.667195 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4910227e-6f80-4ea8-91a6-b0fada745674 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:12.667634 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4910227e-6f80-4ea8-91a6-b0fada745674 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:12.793800 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4910227e-6f80-4ea8-91a6-b0fada745674 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:12.801609 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4910227e-6f80-4ea8-91a6-b0fada745674 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1318 microversion: 2.1 time: 0.146837 May 12 14:36:12.802184 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 327/641] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:12 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:13.369820 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a9db1717-ffa4-4940-a3a6-a2686274fef2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:13.370433 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a9db1717-ffa4-4940-a3a6-a2686274fef2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:13.377162 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a9db1717-ffa4-4940-a3a6-a2686274fef2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:13.377713 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a9db1717-ffa4-4940-a3a6-a2686274fef2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:13.378376 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a9db1717-ffa4-4940-a3a6-a2686274fef2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:13.378820 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a9db1717-ffa4-4940-a3a6-a2686274fef2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:13.509725 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a9db1717-ffa4-4940-a3a6-a2686274fef2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:13.518481 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a9db1717-ffa4-4940-a3a6-a2686274fef2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:13.520014 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a9db1717-ffa4-4940-a3a6-a2686274fef2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:13.521171 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a9db1717-ffa4-4940-a3a6-a2686274fef2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.155345 May 12 14:36:13.521739 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 315/642] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:13 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:13.541440 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-08ade827-3e76-4e0d-96e0-804c05670336 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:13.542050 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-08ade827-3e76-4e0d-96e0-804c05670336 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:13.548320 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-08ade827-3e76-4e0d-96e0-804c05670336 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:13.548777 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-08ade827-3e76-4e0d-96e0-804c05670336 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:13.549549 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-08ade827-3e76-4e0d-96e0-804c05670336 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:13.550009 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-08ade827-3e76-4e0d-96e0-804c05670336 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:13.675694 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-08ade827-3e76-4e0d-96e0-804c05670336 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:13.682810 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-08ade827-3e76-4e0d-96e0-804c05670336 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.145167 May 12 14:36:13.683411 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 328/643] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:13 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:13.818287 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-fbde0f57-acd3-4a76-8fd3-2f33ab1eac0e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:13.818908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-fbde0f57-acd3-4a76-8fd3-2f33ab1eac0e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:13.824752 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fbde0f57-acd3-4a76-8fd3-2f33ab1eac0e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:13.825205 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fbde0f57-acd3-4a76-8fd3-2f33ab1eac0e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:13.825974 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fbde0f57-acd3-4a76-8fd3-2f33ab1eac0e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:13.826420 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fbde0f57-acd3-4a76-8fd3-2f33ab1eac0e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:13.961156 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-fbde0f57-acd3-4a76-8fd3-2f33ab1eac0e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:13.970872 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-fbde0f57-acd3-4a76-8fd3-2f33ab1eac0e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1318 microversion: 2.1 time: 0.156276 May 12 14:36:13.971497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 316/644] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:13 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:14.198804 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-ef4188ff-5d2e-48e6-b8a6-47b74cee5eee req-5907b900-676a-41e6-88ed-47a598d57023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ea87fc-19a5-4d9e-b6c3-7b464c75d052", "name": "network-vif-plugged", "status": "completed", "tag": "1a2cb385-3a41-4cfb-a347-2f9ef44bca18"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:36:14.207094 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-ef4188ff-5d2e-48e6-b8a6-47b74cee5eee req-5907b900-676a-41e6-88ed-47a598d57023 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:14.207500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-ef4188ff-5d2e-48e6-b8a6-47b74cee5eee req-5907b900-676a-41e6-88ed-47a598d57023 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:14.221844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-ef4188ff-5d2e-48e6-b8a6-47b74cee5eee req-5907b900-676a-41e6-88ed-47a598d57023 service nova] Creating event network-vif-plugged:1a2cb385-3a41-4cfb-a347-2f9ef44bca18 for instance 03ea87fc-19a5-4d9e-b6c3-7b464c75d052 on hv-cinder-77703 May 12 14:36:14.227017 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-ef4188ff-5d2e-48e6-b8a6-47b74cee5eee req-5907b900-676a-41e6-88ed-47a598d57023 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031991 May 12 14:36:14.227656 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 329/645] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:36:14.539389 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-86d035e4-1ba5-4323-8103-229ab1bb0b84 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:14.539909 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-86d035e4-1ba5-4323-8103-229ab1bb0b84 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:14.547047 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-86d035e4-1ba5-4323-8103-229ab1bb0b84 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:14.547515 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-86d035e4-1ba5-4323-8103-229ab1bb0b84 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:14.548302 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-86d035e4-1ba5-4323-8103-229ab1bb0b84 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:14.548748 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-86d035e4-1ba5-4323-8103-229ab1bb0b84 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:14.679537 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-86d035e4-1ba5-4323-8103-229ab1bb0b84 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:14.688415 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-86d035e4-1ba5-4323-8103-229ab1bb0b84 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:14.689942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-86d035e4-1ba5-4323-8103-229ab1bb0b84 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:14.691157 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-86d035e4-1ba5-4323-8103-229ab1bb0b84 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.155809 May 12 14:36:14.691730 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 317/646] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:14 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:14.701540 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9eb28f9c-5894-424d-8900-dfb26d785cf9 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:14.702245 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9eb28f9c-5894-424d-8900-dfb26d785cf9 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:14.708543 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9eb28f9c-5894-424d-8900-dfb26d785cf9 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:14.708994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9eb28f9c-5894-424d-8900-dfb26d785cf9 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:14.709772 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9eb28f9c-5894-424d-8900-dfb26d785cf9 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:14.710214 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9eb28f9c-5894-424d-8900-dfb26d785cf9 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:14.843201 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9eb28f9c-5894-424d-8900-dfb26d785cf9 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:14.850457 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9eb28f9c-5894-424d-8900-dfb26d785cf9 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.153648 May 12 14:36:14.851046 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 330/647] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:14 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:14.988305 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7c1388d7-b851-41dd-a82c-6b3fb89938ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:14.988920 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7c1388d7-b851-41dd-a82c-6b3fb89938ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:14.995179 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7c1388d7-b851-41dd-a82c-6b3fb89938ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:14.995614 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7c1388d7-b851-41dd-a82c-6b3fb89938ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:14.996384 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7c1388d7-b851-41dd-a82c-6b3fb89938ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:14.996850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7c1388d7-b851-41dd-a82c-6b3fb89938ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:15.129000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7c1388d7-b851-41dd-a82c-6b3fb89938ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:15.136294 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7c1388d7-b851-41dd-a82c-6b3fb89938ae tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1318 microversion: 2.1 time: 0.151791 May 12 14:36:15.136869 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 318/648] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:14 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:15.709975 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2e429659-7aa4-4508-91a8-d06e60079740 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:15.710537 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2e429659-7aa4-4508-91a8-d06e60079740 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:15.717246 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2e429659-7aa4-4508-91a8-d06e60079740 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:15.717702 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2e429659-7aa4-4508-91a8-d06e60079740 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:15.718492 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2e429659-7aa4-4508-91a8-d06e60079740 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:15.718941 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2e429659-7aa4-4508-91a8-d06e60079740 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:15.867832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e52114d5-e2ba-43e5-8982-58e76cc15cda tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:15.868482 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e52114d5-e2ba-43e5-8982-58e76cc15cda tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:15.876287 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e52114d5-e2ba-43e5-8982-58e76cc15cda tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:15.876751 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e52114d5-e2ba-43e5-8982-58e76cc15cda tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:15.877549 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e52114d5-e2ba-43e5-8982-58e76cc15cda tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:15.878000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e52114d5-e2ba-43e5-8982-58e76cc15cda tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:16.159387 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2e429659-7aa4-4508-91a8-d06e60079740 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:16.175396 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e52114d5-e2ba-43e5-8982-58e76cc15cda tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:16.175610 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2e429659-7aa4-4508-91a8-d06e60079740 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:16.178720 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2e429659-7aa4-4508-91a8-d06e60079740 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:16.180701 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2e429659-7aa4-4508-91a8-d06e60079740 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.474636 May 12 14:36:16.182364 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 331/649] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:15 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:16.182770 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e52114d5-e2ba-43e5-8982-58e76cc15cda tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.318703 May 12 14:36:16.192301 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-667b4566-affa-4fa4-9451-006b2bbe49db tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:16.193565 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 319/650] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:15 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:16.194048 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-667b4566-affa-4fa4-9451-006b2bbe49db tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:16.203776 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-667b4566-affa-4fa4-9451-006b2bbe49db tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:16.204555 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-667b4566-affa-4fa4-9451-006b2bbe49db tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:16.205875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-667b4566-affa-4fa4-9451-006b2bbe49db tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:16.206609 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-667b4566-affa-4fa4-9451-006b2bbe49db tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:16.523921 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-667b4566-affa-4fa4-9451-006b2bbe49db tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:16.532128 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-667b4566-affa-4fa4-9451-006b2bbe49db tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1318 microversion: 2.1 time: 0.347526 May 12 14:36:16.532973 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 332/651] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:16 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:17.200115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-5e2ebcd4-a20d-493b-8e14-5d0762fcb596 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:17.200739 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1e8a4759-39c2-4ec2-8f1b-264ed5ccccd4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:17.201101 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-5e2ebcd4-a20d-493b-8e14-5d0762fcb596 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:17.201194 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1e8a4759-39c2-4ec2-8f1b-264ed5ccccd4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:17.206746 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1e8a4759-39c2-4ec2-8f1b-264ed5ccccd4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:17.207267 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1e8a4759-39c2-4ec2-8f1b-264ed5ccccd4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:17.207468 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5e2ebcd4-a20d-493b-8e14-5d0762fcb596 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:17.207923 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5e2ebcd4-a20d-493b-8e14-5d0762fcb596 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:17.208384 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1e8a4759-39c2-4ec2-8f1b-264ed5ccccd4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:17.208720 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5e2ebcd4-a20d-493b-8e14-5d0762fcb596 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:17.208832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1e8a4759-39c2-4ec2-8f1b-264ed5ccccd4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:17.209169 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5e2ebcd4-a20d-493b-8e14-5d0762fcb596 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:17.681510 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-5e2ebcd4-a20d-493b-8e14-5d0762fcb596 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:17.693327 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-5e2ebcd4-a20d-493b-8e14-5d0762fcb596 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.496985 May 12 14:36:17.694204 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 333/652] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:17 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:17.709771 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1e8a4759-39c2-4ec2-8f1b-264ed5ccccd4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:17.713858 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-49a87da9-5df9-40c9-b63b-7613e0ed9541 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:17.714534 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-49a87da9-5df9-40c9-b63b-7613e0ed9541 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:17.721464 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1e8a4759-39c2-4ec2-8f1b-264ed5ccccd4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:17.722446 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-49a87da9-5df9-40c9-b63b-7613e0ed9541 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:17.722903 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-49a87da9-5df9-40c9-b63b-7613e0ed9541 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:17.723757 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-49a87da9-5df9-40c9-b63b-7613e0ed9541 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:17.724198 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-49a87da9-5df9-40c9-b63b-7613e0ed9541 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:17.725414 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1e8a4759-39c2-4ec2-8f1b-264ed5ccccd4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:17.728535 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1e8a4759-39c2-4ec2-8f1b-264ed5ccccd4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.532505 May 12 14:36:17.735204 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 320/653] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:17 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:17.902751 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-49a87da9-5df9-40c9-b63b-7613e0ed9541 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:17.922082 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-49a87da9-5df9-40c9-b63b-7613e0ed9541 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1318 microversion: 2.1 time: 0.226610 May 12 14:36:17.924479 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 334/654] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:17 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:18.716474 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ec5b40b8-40f2-4b19-bac9-b0ebdbbcdce2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:18.717134 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ec5b40b8-40f2-4b19-bac9-b0ebdbbcdce2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:18.723493 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ec5b40b8-40f2-4b19-bac9-b0ebdbbcdce2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:18.723945 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ec5b40b8-40f2-4b19-bac9-b0ebdbbcdce2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:18.724734 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ec5b40b8-40f2-4b19-bac9-b0ebdbbcdce2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:18.725273 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ec5b40b8-40f2-4b19-bac9-b0ebdbbcdce2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:18.734529 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-f1a98918-ecde-4831-b30f-acce753eee12 req-5aa49f66-7645-480e-b015-897957716206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e40740-6dab-4657-abc3-eb83ee4b4c4d", "name": "network-vif-plugged", "status": "completed", "tag": "1d9bd042-8dc9-4559-9211-62f3a465dca4"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:36:18.744319 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-f1a98918-ecde-4831-b30f-acce753eee12 req-5aa49f66-7645-480e-b015-897957716206 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:18.744859 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-f1a98918-ecde-4831-b30f-acce753eee12 req-5aa49f66-7645-480e-b015-897957716206 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:18.758159 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-f1a98918-ecde-4831-b30f-acce753eee12 req-5aa49f66-7645-480e-b015-897957716206 service nova] Creating event network-vif-plugged:1d9bd042-8dc9-4559-9211-62f3a465dca4 for instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d on hv-cinder-77703 May 12 14:36:18.763330 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-f1a98918-ecde-4831-b30f-acce753eee12 req-5aa49f66-7645-480e-b015-897957716206 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032512 May 12 14:36:18.764015 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 335/655] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:36:18.769881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-88612bdd-9c00-43b5-8cbe-ab43fe64d2a8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:18.772243 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-88612bdd-9c00-43b5-8cbe-ab43fe64d2a8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:18.776888 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-88612bdd-9c00-43b5-8cbe-ab43fe64d2a8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:18.777558 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-88612bdd-9c00-43b5-8cbe-ab43fe64d2a8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:18.778351 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-88612bdd-9c00-43b5-8cbe-ab43fe64d2a8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:18.778800 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-88612bdd-9c00-43b5-8cbe-ab43fe64d2a8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:18.933377 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ec5b40b8-40f2-4b19-bac9-b0ebdbbcdce2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:18.945766 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ec5b40b8-40f2-4b19-bac9-b0ebdbbcdce2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.232833 May 12 14:36:18.951162 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 321/656] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:18 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:18.957084 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a8dd86b5-271c-4cb4-97f3-e0936326e450 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:18.958037 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a8dd86b5-271c-4cb4-97f3-e0936326e450 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:18.966845 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-88612bdd-9c00-43b5-8cbe-ab43fe64d2a8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:18.967741 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8dd86b5-271c-4cb4-97f3-e0936326e450 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:18.968509 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8dd86b5-271c-4cb4-97f3-e0936326e450 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:18.969508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8dd86b5-271c-4cb4-97f3-e0936326e450 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:18.970150 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8dd86b5-271c-4cb4-97f3-e0936326e450 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:18.989567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-88612bdd-9c00-43b5-8cbe-ab43fe64d2a8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:18.994118 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-88612bdd-9c00-43b5-8cbe-ab43fe64d2a8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:18.995975 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-88612bdd-9c00-43b5-8cbe-ab43fe64d2a8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.229644 May 12 14:36:18.996696 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 336/657] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:18 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:19.118651 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a8dd86b5-271c-4cb4-97f3-e0936326e450 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:19.126907 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a8dd86b5-271c-4cb4-97f3-e0936326e450 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1507 microversion: 2.1 time: 0.174671 May 12 14:36:19.127518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 322/658] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:18 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:19.143153 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-70a21f1b-f128-4029-b78a-a40fe08d0ee2 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0976804-6dff-4ace-bd92-72de104e4ffc", "device": "/dev/sdb"}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:36:19.144787 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-70a21f1b-f128-4029-b78a-a40fe08d0ee2 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:19.151306 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-70a21f1b-f128-4029-b78a-a40fe08d0ee2 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:19.151764 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-70a21f1b-f128-4029-b78a-a40fe08d0ee2 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:19.152542 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-70a21f1b-f128-4029-b78a-a40fe08d0ee2 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:19.152973 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-70a21f1b-f128-4029-b78a-a40fe08d0ee2 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:19.962885 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-590c872e-8e8f-4516-99c3-e13f96bfdf0b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:19.964147 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-590c872e-8e8f-4516-99c3-e13f96bfdf0b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:19.970918 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-590c872e-8e8f-4516-99c3-e13f96bfdf0b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:19.971408 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-590c872e-8e8f-4516-99c3-e13f96bfdf0b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:19.972193 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-590c872e-8e8f-4516-99c3-e13f96bfdf0b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:19.972648 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-590c872e-8e8f-4516-99c3-e13f96bfdf0b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:20.118323 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-590c872e-8e8f-4516-99c3-e13f96bfdf0b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:20.128433 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-590c872e-8e8f-4516-99c3-e13f96bfdf0b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.169437 May 12 14:36:20.129024 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 323/659] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:19 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:20.133565 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e3119a9b-bba5-4db8-bf3f-61848e1b7716 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:20.134178 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e3119a9b-bba5-4db8-bf3f-61848e1b7716 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:20.140321 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e3119a9b-bba5-4db8-bf3f-61848e1b7716 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:20.140770 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e3119a9b-bba5-4db8-bf3f-61848e1b7716 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:20.141575 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e3119a9b-bba5-4db8-bf3f-61848e1b7716 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:20.142017 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e3119a9b-bba5-4db8-bf3f-61848e1b7716 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:20.278414 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e3119a9b-bba5-4db8-bf3f-61848e1b7716 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:20.290038 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e3119a9b-bba5-4db8-bf3f-61848e1b7716 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:20.291644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e3119a9b-bba5-4db8-bf3f-61848e1b7716 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:20.292931 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e3119a9b-bba5-4db8-bf3f-61848e1b7716 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.162954 May 12 14:36:20.293499 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 324/660] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:20 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:21.145451 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5ea363bb-ac06-463e-94c1-d2a85049262e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:21.146121 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5ea363bb-ac06-463e-94c1-d2a85049262e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:21.152778 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ea363bb-ac06-463e-94c1-d2a85049262e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:21.153230 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ea363bb-ac06-463e-94c1-d2a85049262e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:21.154017 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ea363bb-ac06-463e-94c1-d2a85049262e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:21.154459 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ea363bb-ac06-463e-94c1-d2a85049262e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:21.284365 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5ea363bb-ac06-463e-94c1-d2a85049262e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:21.291576 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5ea363bb-ac06-463e-94c1-d2a85049262e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.150047 May 12 14:36:21.292144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 325/661] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:21 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:21.311237 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ce43b3ca-b690-468a-b58d-adf54c9ae658 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:21.311842 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ce43b3ca-b690-468a-b58d-adf54c9ae658 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:21.317531 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ce43b3ca-b690-468a-b58d-adf54c9ae658 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:21.317983 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ce43b3ca-b690-468a-b58d-adf54c9ae658 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:21.318749 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ce43b3ca-b690-468a-b58d-adf54c9ae658 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:21.319228 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ce43b3ca-b690-468a-b58d-adf54c9ae658 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:21.448021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ce43b3ca-b690-468a-b58d-adf54c9ae658 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:21.456761 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ce43b3ca-b690-468a-b58d-adf54c9ae658 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:21.458257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ce43b3ca-b690-468a-b58d-adf54c9ae658 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:21.459445 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ce43b3ca-b690-468a-b58d-adf54c9ae658 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.151776 May 12 14:36:21.460007 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 326/662] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:21 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:22.308322 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-65865f49-8916-45fd-a774-487726258066 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:22.309008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-65865f49-8916-45fd-a774-487726258066 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:22.316289 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-65865f49-8916-45fd-a774-487726258066 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:22.316746 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-65865f49-8916-45fd-a774-487726258066 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:22.317525 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-65865f49-8916-45fd-a774-487726258066 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:22.317966 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-65865f49-8916-45fd-a774-487726258066 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:22.457826 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-65865f49-8916-45fd-a774-487726258066 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:22.465838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-65865f49-8916-45fd-a774-487726258066 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.161366 May 12 14:36:22.466425 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 327/663] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:22 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:22.477953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3545d648-85ee-41e0-a55d-feda3611dd20 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:22.478824 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3545d648-85ee-41e0-a55d-feda3611dd20 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:22.486838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3545d648-85ee-41e0-a55d-feda3611dd20 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:22.487317 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3545d648-85ee-41e0-a55d-feda3611dd20 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:22.488104 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3545d648-85ee-41e0-a55d-feda3611dd20 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:22.488539 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3545d648-85ee-41e0-a55d-feda3611dd20 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:22.637477 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3545d648-85ee-41e0-a55d-feda3611dd20 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:22.647306 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3545d648-85ee-41e0-a55d-feda3611dd20 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:22.648827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3545d648-85ee-41e0-a55d-feda3611dd20 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:22.650065 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3545d648-85ee-41e0-a55d-feda3611dd20 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.176044 May 12 14:36:22.650676 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 328/664] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:22 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:23.486297 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1aea34d7-379c-498b-87c7-21be340dd413 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:23.487001 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1aea34d7-379c-498b-87c7-21be340dd413 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:23.493378 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1aea34d7-379c-498b-87c7-21be340dd413 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:23.493835 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1aea34d7-379c-498b-87c7-21be340dd413 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:23.494615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1aea34d7-379c-498b-87c7-21be340dd413 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:23.495079 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1aea34d7-379c-498b-87c7-21be340dd413 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:23.622796 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1aea34d7-379c-498b-87c7-21be340dd413 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:23.630941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1aea34d7-379c-498b-87c7-21be340dd413 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.149077 May 12 14:36:23.631549 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 329/665] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:23 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:23.668605 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d73aa871-64a1-4846-a98e-429e461c96a0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:23.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d73aa871-64a1-4846-a98e-429e461c96a0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:23.675791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d73aa871-64a1-4846-a98e-429e461c96a0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:23.676252 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d73aa871-64a1-4846-a98e-429e461c96a0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:23.677030 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d73aa871-64a1-4846-a98e-429e461c96a0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:23.677472 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d73aa871-64a1-4846-a98e-429e461c96a0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:23.819509 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d73aa871-64a1-4846-a98e-429e461c96a0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:23.827969 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d73aa871-64a1-4846-a98e-429e461c96a0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:23.829473 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d73aa871-64a1-4846-a98e-429e461c96a0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:23.830624 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d73aa871-64a1-4846-a98e-429e461c96a0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.165843 May 12 14:36:23.831216 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 330/666] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:23 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:24.647566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f0dcf3d9-12b5-4de7-9d8c-f7653383eb8c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:24.648252 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f0dcf3d9-12b5-4de7-9d8c-f7653383eb8c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:24.655279 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f0dcf3d9-12b5-4de7-9d8c-f7653383eb8c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:24.655739 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f0dcf3d9-12b5-4de7-9d8c-f7653383eb8c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:24.656530 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f0dcf3d9-12b5-4de7-9d8c-f7653383eb8c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:24.656963 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f0dcf3d9-12b5-4de7-9d8c-f7653383eb8c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:24.789730 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f0dcf3d9-12b5-4de7-9d8c-f7653383eb8c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:24.797022 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f0dcf3d9-12b5-4de7-9d8c-f7653383eb8c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.153320 May 12 14:36:24.797585 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 331/667] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:24 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:24.848827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4221bdad-7995-488b-bbb9-f7eb87abbb57 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:24.849443 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4221bdad-7995-488b-bbb9-f7eb87abbb57 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:24.855414 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4221bdad-7995-488b-bbb9-f7eb87abbb57 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:24.855864 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4221bdad-7995-488b-bbb9-f7eb87abbb57 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:24.856638 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4221bdad-7995-488b-bbb9-f7eb87abbb57 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:24.857076 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4221bdad-7995-488b-bbb9-f7eb87abbb57 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:25.004236 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4221bdad-7995-488b-bbb9-f7eb87abbb57 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:25.012457 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4221bdad-7995-488b-bbb9-f7eb87abbb57 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:25.013998 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4221bdad-7995-488b-bbb9-f7eb87abbb57 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:25.015180 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4221bdad-7995-488b-bbb9-f7eb87abbb57 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.170244 May 12 14:36:25.015756 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 332/668] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:24 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:25.814150 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f5d7fd44-1090-4548-a727-87e435a03985 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:25.814887 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f5d7fd44-1090-4548-a727-87e435a03985 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:25.821403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f5d7fd44-1090-4548-a727-87e435a03985 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:25.821852 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f5d7fd44-1090-4548-a727-87e435a03985 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:25.822637 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f5d7fd44-1090-4548-a727-87e435a03985 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:25.823101 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f5d7fd44-1090-4548-a727-87e435a03985 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:25.958823 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f5d7fd44-1090-4548-a727-87e435a03985 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:25.966292 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f5d7fd44-1090-4548-a727-87e435a03985 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.156424 May 12 14:36:25.966873 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 333/669] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:25 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:26.034118 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3b0efc3e-51bf-4b01-95ec-4cb9894cd921 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:26.034811 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3b0efc3e-51bf-4b01-95ec-4cb9894cd921 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:26.040822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3b0efc3e-51bf-4b01-95ec-4cb9894cd921 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:26.041274 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3b0efc3e-51bf-4b01-95ec-4cb9894cd921 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:26.042042 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3b0efc3e-51bf-4b01-95ec-4cb9894cd921 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:26.042483 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3b0efc3e-51bf-4b01-95ec-4cb9894cd921 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:26.180034 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3b0efc3e-51bf-4b01-95ec-4cb9894cd921 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:26.189603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3b0efc3e-51bf-4b01-95ec-4cb9894cd921 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:26.191207 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3b0efc3e-51bf-4b01-95ec-4cb9894cd921 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:26.192512 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3b0efc3e-51bf-4b01-95ec-4cb9894cd921 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.162944 May 12 14:36:26.193290 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 334/670] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:26 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:26.983918 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-630e543e-8978-4258-98d4-624e1d8b0bab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:26.984573 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-630e543e-8978-4258-98d4-624e1d8b0bab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:26.991738 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-630e543e-8978-4258-98d4-624e1d8b0bab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:26.992202 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-630e543e-8978-4258-98d4-624e1d8b0bab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:26.992995 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-630e543e-8978-4258-98d4-624e1d8b0bab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:26.993443 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-630e543e-8978-4258-98d4-624e1d8b0bab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:27.125398 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-630e543e-8978-4258-98d4-624e1d8b0bab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:27.132922 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-630e543e-8978-4258-98d4-624e1d8b0bab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.153095 May 12 14:36:27.133498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 335/671] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:26 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:27.319520 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-49a7caa0-18f1-4735-8073-308c7436ed85 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:27.320139 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-49a7caa0-18f1-4735-8073-308c7436ed85 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:27.326114 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-49a7caa0-18f1-4735-8073-308c7436ed85 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:27.326608 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-49a7caa0-18f1-4735-8073-308c7436ed85 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:27.327475 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-49a7caa0-18f1-4735-8073-308c7436ed85 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:27.327918 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-49a7caa0-18f1-4735-8073-308c7436ed85 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:27.461425 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-49a7caa0-18f1-4735-8073-308c7436ed85 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:27.470379 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-49a7caa0-18f1-4735-8073-308c7436ed85 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:27.471918 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-49a7caa0-18f1-4735-8073-308c7436ed85 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:27.473101 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-49a7caa0-18f1-4735-8073-308c7436ed85 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.265459 May 12 14:36:27.473672 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 336/672] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:27 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:27.919284 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:36:27.919533 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Thu May 12 14:36:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:36:28.150959 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-6acf464d-786b-4c0c-bcf7-4334bf904315 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:28.151708 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-6acf464d-786b-4c0c-bcf7-4334bf904315 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:28.159061 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6acf464d-786b-4c0c-bcf7-4334bf904315 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:28.159533 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6acf464d-786b-4c0c-bcf7-4334bf904315 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:28.160319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6acf464d-786b-4c0c-bcf7-4334bf904315 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:28.160765 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6acf464d-786b-4c0c-bcf7-4334bf904315 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:28.298687 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-6acf464d-786b-4c0c-bcf7-4334bf904315 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:28.306281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-6acf464d-786b-4c0c-bcf7-4334bf904315 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.159159 May 12 14:36:28.317071 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 337/673] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:28 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:28.491563 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b9a05539-53b1-4508-9729-ca41cca0d346 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:28.492089 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b9a05539-53b1-4508-9729-ca41cca0d346 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:28.498884 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9a05539-53b1-4508-9729-ca41cca0d346 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:28.499617 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9a05539-53b1-4508-9729-ca41cca0d346 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:28.500390 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9a05539-53b1-4508-9729-ca41cca0d346 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:28.500828 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9a05539-53b1-4508-9729-ca41cca0d346 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:28.652048 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b9a05539-53b1-4508-9729-ca41cca0d346 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:28.660772 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b9a05539-53b1-4508-9729-ca41cca0d346 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:28.662269 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b9a05539-53b1-4508-9729-ca41cca0d346 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:28.663452 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b9a05539-53b1-4508-9729-ca41cca0d346 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.175931 May 12 14:36:28.664016 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 338/674] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:28 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:29.323609 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2abfdf18-aadf-4caf-b7f7-b6bd90039f28 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:29.324308 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2abfdf18-aadf-4caf-b7f7-b6bd90039f28 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:29.331291 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2abfdf18-aadf-4caf-b7f7-b6bd90039f28 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:29.331750 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2abfdf18-aadf-4caf-b7f7-b6bd90039f28 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:29.332538 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2abfdf18-aadf-4caf-b7f7-b6bd90039f28 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:29.332980 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2abfdf18-aadf-4caf-b7f7-b6bd90039f28 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:29.458605 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2abfdf18-aadf-4caf-b7f7-b6bd90039f28 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:29.465824 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2abfdf18-aadf-4caf-b7f7-b6bd90039f28 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.146075 May 12 14:36:29.466389 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 339/675] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:29 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:29.681727 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-75fa4404-f87e-458a-8e7d-473070a36727 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:29.682265 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-75fa4404-f87e-458a-8e7d-473070a36727 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:29.688904 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-75fa4404-f87e-458a-8e7d-473070a36727 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:29.689364 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-75fa4404-f87e-458a-8e7d-473070a36727 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:29.690141 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-75fa4404-f87e-458a-8e7d-473070a36727 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:29.690586 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-75fa4404-f87e-458a-8e7d-473070a36727 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:29.818732 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-75fa4404-f87e-458a-8e7d-473070a36727 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:29.826888 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-75fa4404-f87e-458a-8e7d-473070a36727 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:29.828451 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-75fa4404-f87e-458a-8e7d-473070a36727 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:29.829602 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-75fa4404-f87e-458a-8e7d-473070a36727 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.151881 May 12 14:36:29.830170 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 340/676] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:29 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:30.482584 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f1c12561-206b-477f-8918-ec5de6aeddf2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:30.483336 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f1c12561-206b-477f-8918-ec5de6aeddf2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:30.489539 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f1c12561-206b-477f-8918-ec5de6aeddf2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:30.489994 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f1c12561-206b-477f-8918-ec5de6aeddf2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:30.490767 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f1c12561-206b-477f-8918-ec5de6aeddf2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:30.491253 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f1c12561-206b-477f-8918-ec5de6aeddf2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:30.616264 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f1c12561-206b-477f-8918-ec5de6aeddf2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:30.623927 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f1c12561-206b-477f-8918-ec5de6aeddf2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.145293 May 12 14:36:30.624859 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 341/677] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:30 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:30.847883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5db03902-0337-4299-9e84-a3a6540bd202 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:30.848497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5db03902-0337-4299-9e84-a3a6540bd202 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:30.854629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5db03902-0337-4299-9e84-a3a6540bd202 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:30.855001 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5db03902-0337-4299-9e84-a3a6540bd202 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:30.855809 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5db03902-0337-4299-9e84-a3a6540bd202 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:30.856251 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5db03902-0337-4299-9e84-a3a6540bd202 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:30.991106 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5db03902-0337-4299-9e84-a3a6540bd202 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:31.000513 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5db03902-0337-4299-9e84-a3a6540bd202 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:31.002006 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5db03902-0337-4299-9e84-a3a6540bd202 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:31.003187 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5db03902-0337-4299-9e84-a3a6540bd202 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.159299 May 12 14:36:31.003755 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 342/678] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:30 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:31.640909 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-af00cefe-6f3e-41ea-b9cb-abf092e2d822 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:31.641645 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-af00cefe-6f3e-41ea-b9cb-abf092e2d822 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:31.647991 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-af00cefe-6f3e-41ea-b9cb-abf092e2d822 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:31.648448 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-af00cefe-6f3e-41ea-b9cb-abf092e2d822 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:31.649220 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-af00cefe-6f3e-41ea-b9cb-abf092e2d822 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:31.649655 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-af00cefe-6f3e-41ea-b9cb-abf092e2d822 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:31.797148 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-af00cefe-6f3e-41ea-b9cb-abf092e2d822 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:31.804979 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-af00cefe-6f3e-41ea-b9cb-abf092e2d822 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.167906 May 12 14:36:31.805635 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 343/679] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:31 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:32.021772 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-532fafdc-5c03-4967-84f9-c633240969bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:32.022388 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-532fafdc-5c03-4967-84f9-c633240969bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:32.028419 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-532fafdc-5c03-4967-84f9-c633240969bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:32.028900 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-532fafdc-5c03-4967-84f9-c633240969bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:32.030257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-532fafdc-5c03-4967-84f9-c633240969bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:32.030702 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-532fafdc-5c03-4967-84f9-c633240969bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:32.192772 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-532fafdc-5c03-4967-84f9-c633240969bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:32.202265 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-532fafdc-5c03-4967-84f9-c633240969bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:32.203879 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-532fafdc-5c03-4967-84f9-c633240969bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:32.205068 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-532fafdc-5c03-4967-84f9-c633240969bb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.187244 May 12 14:36:32.205638 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 344/680] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:32 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:32.822772 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c8f037c0-95d1-4ca3-ab71-070858ba50bc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:32.823629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c8f037c0-95d1-4ca3-ab71-070858ba50bc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:32.830782 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c8f037c0-95d1-4ca3-ab71-070858ba50bc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:32.831277 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c8f037c0-95d1-4ca3-ab71-070858ba50bc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:32.832075 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c8f037c0-95d1-4ca3-ab71-070858ba50bc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:32.832550 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c8f037c0-95d1-4ca3-ab71-070858ba50bc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:32.969681 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c8f037c0-95d1-4ca3-ab71-070858ba50bc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:32.977205 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c8f037c0-95d1-4ca3-ab71-070858ba50bc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.158353 May 12 14:36:32.977777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 345/681] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:32 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:33.224121 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ae3e361f-39e6-47c2-8335-a6c7d23b48fa tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:33.224692 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ae3e361f-39e6-47c2-8335-a6c7d23b48fa tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:33.230922 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ae3e361f-39e6-47c2-8335-a6c7d23b48fa tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:33.231423 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ae3e361f-39e6-47c2-8335-a6c7d23b48fa tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:33.232220 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ae3e361f-39e6-47c2-8335-a6c7d23b48fa tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:33.232664 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ae3e361f-39e6-47c2-8335-a6c7d23b48fa tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:33.407334 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ae3e361f-39e6-47c2-8335-a6c7d23b48fa tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:33.416450 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ae3e361f-39e6-47c2-8335-a6c7d23b48fa tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:33.417753 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ae3e361f-39e6-47c2-8335-a6c7d23b48fa tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:33.418930 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ae3e361f-39e6-47c2-8335-a6c7d23b48fa tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.198938 May 12 14:36:33.419532 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 346/682] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:33 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:33.993590 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-386b2dd0-441f-4138-a8ee-c1a91e4b8c0f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:33.994284 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-386b2dd0-441f-4138-a8ee-c1a91e4b8c0f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:34.001229 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-386b2dd0-441f-4138-a8ee-c1a91e4b8c0f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:34.001681 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-386b2dd0-441f-4138-a8ee-c1a91e4b8c0f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:34.002448 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-386b2dd0-441f-4138-a8ee-c1a91e4b8c0f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:34.002885 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-386b2dd0-441f-4138-a8ee-c1a91e4b8c0f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:34.139890 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-386b2dd0-441f-4138-a8ee-c1a91e4b8c0f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:34.147251 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-386b2dd0-441f-4138-a8ee-c1a91e4b8c0f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.157553 May 12 14:36:34.147825 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 347/683] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:33 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:34.439599 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a6efc307-5e6e-4d52-9da1-b33d278e2dcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:34.440212 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a6efc307-5e6e-4d52-9da1-b33d278e2dcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:34.446064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a6efc307-5e6e-4d52-9da1-b33d278e2dcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:34.446517 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a6efc307-5e6e-4d52-9da1-b33d278e2dcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:34.447311 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a6efc307-5e6e-4d52-9da1-b33d278e2dcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:34.447751 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a6efc307-5e6e-4d52-9da1-b33d278e2dcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:34.582191 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a6efc307-5e6e-4d52-9da1-b33d278e2dcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:34.592778 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a6efc307-5e6e-4d52-9da1-b33d278e2dcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:34.594650 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a6efc307-5e6e-4d52-9da1-b33d278e2dcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:34.596133 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a6efc307-5e6e-4d52-9da1-b33d278e2dcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.160475 May 12 14:36:34.596937 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 348/684] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:34 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:35.164688 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8b90ce15-ae2e-4c4a-a870-bab6b4cee64d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:35.165429 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8b90ce15-ae2e-4c4a-a870-bab6b4cee64d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:35.176374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b90ce15-ae2e-4c4a-a870-bab6b4cee64d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:35.176374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b90ce15-ae2e-4c4a-a870-bab6b4cee64d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:35.176374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b90ce15-ae2e-4c4a-a870-bab6b4cee64d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:35.176374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b90ce15-ae2e-4c4a-a870-bab6b4cee64d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:35.337838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8b90ce15-ae2e-4c4a-a870-bab6b4cee64d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:35.346990 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8b90ce15-ae2e-4c4a-a870-bab6b4cee64d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.186270 May 12 14:36:35.347614 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 349/685] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:35 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:35.625206 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3e6cc699-597b-486e-b057-25fff381f006 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:35.625609 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3e6cc699-597b-486e-b057-25fff381f006 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:35.637529 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e6cc699-597b-486e-b057-25fff381f006 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:35.638417 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e6cc699-597b-486e-b057-25fff381f006 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:35.639912 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e6cc699-597b-486e-b057-25fff381f006 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:35.641499 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3e6cc699-597b-486e-b057-25fff381f006 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:35.785422 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3e6cc699-597b-486e-b057-25fff381f006 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:35.793725 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3e6cc699-597b-486e-b057-25fff381f006 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:35.795793 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3e6cc699-597b-486e-b057-25fff381f006 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:35.796963 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3e6cc699-597b-486e-b057-25fff381f006 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.176255 May 12 14:36:35.797531 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 350/686] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:35 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:36.364159 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-cb3b76ae-8c96-4884-84b0-352da5540048 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:36.364865 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-cb3b76ae-8c96-4884-84b0-352da5540048 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:36.371130 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cb3b76ae-8c96-4884-84b0-352da5540048 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:36.371613 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cb3b76ae-8c96-4884-84b0-352da5540048 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:36.372378 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cb3b76ae-8c96-4884-84b0-352da5540048 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:36.373403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cb3b76ae-8c96-4884-84b0-352da5540048 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:36.501212 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-cb3b76ae-8c96-4884-84b0-352da5540048 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:36.508462 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-cb3b76ae-8c96-4884-84b0-352da5540048 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.148172 May 12 14:36:36.509034 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 351/687] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:36 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:36.815746 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4f102424-f5d5-4f9e-b675-53aaf7316a16 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:36.816281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4f102424-f5d5-4f9e-b675-53aaf7316a16 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:36.822443 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4f102424-f5d5-4f9e-b675-53aaf7316a16 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:36.822900 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4f102424-f5d5-4f9e-b675-53aaf7316a16 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:36.823715 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4f102424-f5d5-4f9e-b675-53aaf7316a16 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:36.824163 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4f102424-f5d5-4f9e-b675-53aaf7316a16 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:36.955673 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4f102424-f5d5-4f9e-b675-53aaf7316a16 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:36.964494 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4f102424-f5d5-4f9e-b675-53aaf7316a16 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:36.966008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4f102424-f5d5-4f9e-b675-53aaf7316a16 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:36.967228 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4f102424-f5d5-4f9e-b675-53aaf7316a16 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.155440 May 12 14:36:36.967797 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 352/688] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:36 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:37.524999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-de80f247-d97a-4432-a40f-c514c85b1ffd tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:37.525682 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-de80f247-d97a-4432-a40f-c514c85b1ffd tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:37.532079 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-de80f247-d97a-4432-a40f-c514c85b1ffd tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:37.532549 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-de80f247-d97a-4432-a40f-c514c85b1ffd tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:37.533331 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-de80f247-d97a-4432-a40f-c514c85b1ffd tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:37.533779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-de80f247-d97a-4432-a40f-c514c85b1ffd tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:37.663581 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-de80f247-d97a-4432-a40f-c514c85b1ffd tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:37.671536 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-de80f247-d97a-4432-a40f-c514c85b1ffd tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.150331 May 12 14:36:37.672127 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 353/689] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:37 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:37.985465 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b7f6a10b-26f7-4471-a071-b49931cdb065 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:37.986088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b7f6a10b-26f7-4471-a071-b49931cdb065 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:37.992234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b7f6a10b-26f7-4471-a071-b49931cdb065 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:37.992705 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b7f6a10b-26f7-4471-a071-b49931cdb065 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:37.993476 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b7f6a10b-26f7-4471-a071-b49931cdb065 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:37.993918 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b7f6a10b-26f7-4471-a071-b49931cdb065 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:38.118749 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b7f6a10b-26f7-4471-a071-b49931cdb065 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:38.127787 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b7f6a10b-26f7-4471-a071-b49931cdb065 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:38.129298 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b7f6a10b-26f7-4471-a071-b49931cdb065 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:38.130456 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b7f6a10b-26f7-4471-a071-b49931cdb065 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.148958 May 12 14:36:38.131021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 354/690] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:37 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:38.688272 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ab5c8809-35e5-4917-b83a-6540bc1b1579 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:38.688908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ab5c8809-35e5-4917-b83a-6540bc1b1579 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:38.695128 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ab5c8809-35e5-4917-b83a-6540bc1b1579 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:38.695582 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ab5c8809-35e5-4917-b83a-6540bc1b1579 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:38.696352 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ab5c8809-35e5-4917-b83a-6540bc1b1579 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:38.696788 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ab5c8809-35e5-4917-b83a-6540bc1b1579 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:38.833476 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ab5c8809-35e5-4917-b83a-6540bc1b1579 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:38.841043 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ab5c8809-35e5-4917-b83a-6540bc1b1579 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.157409 May 12 14:36:38.842121 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 355/691] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:38 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:39.149174 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-15fd4b81-793a-444a-9d5d-34dacdf20742 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:39.149783 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-15fd4b81-793a-444a-9d5d-34dacdf20742 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:39.155737 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-15fd4b81-793a-444a-9d5d-34dacdf20742 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:39.156190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-15fd4b81-793a-444a-9d5d-34dacdf20742 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:39.156962 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-15fd4b81-793a-444a-9d5d-34dacdf20742 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:39.157403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-15fd4b81-793a-444a-9d5d-34dacdf20742 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:39.295495 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-15fd4b81-793a-444a-9d5d-34dacdf20742 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:39.304112 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-15fd4b81-793a-444a-9d5d-34dacdf20742 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:39.305584 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-15fd4b81-793a-444a-9d5d-34dacdf20742 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:39.306758 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-15fd4b81-793a-444a-9d5d-34dacdf20742 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.161550 May 12 14:36:39.307669 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 356/692] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:39 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:39.858619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-433457a7-b1b6-4fdb-836f-b1b295caa9b2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:39.859347 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-433457a7-b1b6-4fdb-836f-b1b295caa9b2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:39.866121 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-433457a7-b1b6-4fdb-836f-b1b295caa9b2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:39.866578 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-433457a7-b1b6-4fdb-836f-b1b295caa9b2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:39.867409 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-433457a7-b1b6-4fdb-836f-b1b295caa9b2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:39.867852 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-433457a7-b1b6-4fdb-836f-b1b295caa9b2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:40.002370 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-433457a7-b1b6-4fdb-836f-b1b295caa9b2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:40.009674 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-433457a7-b1b6-4fdb-836f-b1b295caa9b2 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.155720 May 12 14:36:40.010265 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 357/693] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:39 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:40.325193 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-16a5e154-df3a-497f-ac9f-ab4ae2db6e37 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:40.326343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-16a5e154-df3a-497f-ac9f-ab4ae2db6e37 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:40.332406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-16a5e154-df3a-497f-ac9f-ab4ae2db6e37 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:40.332875 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-16a5e154-df3a-497f-ac9f-ab4ae2db6e37 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:40.333628 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-16a5e154-df3a-497f-ac9f-ab4ae2db6e37 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:40.334065 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-16a5e154-df3a-497f-ac9f-ab4ae2db6e37 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:40.459998 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-16a5e154-df3a-497f-ac9f-ab4ae2db6e37 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:40.468231 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-16a5e154-df3a-497f-ac9f-ab4ae2db6e37 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:40.469732 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-16a5e154-df3a-497f-ac9f-ab4ae2db6e37 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:40.470882 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-16a5e154-df3a-497f-ac9f-ab4ae2db6e37 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.149664 May 12 14:36:40.471473 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 358/694] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:40 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:41.026860 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2b10a5f4-ca2d-46cf-a839-7f659ed67330 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:41.027580 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2b10a5f4-ca2d-46cf-a839-7f659ed67330 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:41.035206 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2b10a5f4-ca2d-46cf-a839-7f659ed67330 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:41.035668 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2b10a5f4-ca2d-46cf-a839-7f659ed67330 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:41.036465 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2b10a5f4-ca2d-46cf-a839-7f659ed67330 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:41.036913 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2b10a5f4-ca2d-46cf-a839-7f659ed67330 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:41.287962 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2b10a5f4-ca2d-46cf-a839-7f659ed67330 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:41.295396 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2b10a5f4-ca2d-46cf-a839-7f659ed67330 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.272314 May 12 14:36:41.296055 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 359/695] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:41 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:41.491693 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4a900d1a-2982-4f76-991f-8f3a71864ee1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:41.492364 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4a900d1a-2982-4f76-991f-8f3a71864ee1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:41.501659 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4a900d1a-2982-4f76-991f-8f3a71864ee1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:41.503067 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4a900d1a-2982-4f76-991f-8f3a71864ee1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:41.504161 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4a900d1a-2982-4f76-991f-8f3a71864ee1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:41.504621 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4a900d1a-2982-4f76-991f-8f3a71864ee1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:41.588284 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-70a21f1b-f128-4029-b78a-a40fe08d0ee2 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "POST /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 22.448974 May 12 14:36:41.589218 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 337/696] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 12 14:36:19 2022] POST /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052/os-volume_attachments => generated 194 bytes in 22451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:36:41.830402 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4a900d1a-2982-4f76-991f-8f3a71864ee1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:41.839359 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4a900d1a-2982-4f76-991f-8f3a71864ee1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:41.840877 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4a900d1a-2982-4f76-991f-8f3a71864ee1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:41.842565 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4a900d1a-2982-4f76-991f-8f3a71864ee1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.357384 May 12 14:36:41.843227 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 360/697] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:41 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:36:42.313439 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-65828cc8-e961-43fd-a7c3-0bab2db5742e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:42.314164 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-65828cc8-e961-43fd-a7c3-0bab2db5742e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:42.320495 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-65828cc8-e961-43fd-a7c3-0bab2db5742e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:42.320953 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-65828cc8-e961-43fd-a7c3-0bab2db5742e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:42.321739 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-65828cc8-e961-43fd-a7c3-0bab2db5742e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:42.322206 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-65828cc8-e961-43fd-a7c3-0bab2db5742e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:42.451952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-65828cc8-e961-43fd-a7c3-0bab2db5742e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:42.459471 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-65828cc8-e961-43fd-a7c3-0bab2db5742e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.151323 May 12 14:36:42.460065 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 338/698] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:42 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:42.861493 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-dde5014f-cb7e-4fb5-8840-31cccbd377da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:42.862114 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-dde5014f-cb7e-4fb5-8840-31cccbd377da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:42.868517 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dde5014f-cb7e-4fb5-8840-31cccbd377da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:42.868974 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dde5014f-cb7e-4fb5-8840-31cccbd377da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:42.869755 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dde5014f-cb7e-4fb5-8840-31cccbd377da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:42.870197 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dde5014f-cb7e-4fb5-8840-31cccbd377da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:43.008998 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-dde5014f-cb7e-4fb5-8840-31cccbd377da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:43.020141 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-dde5014f-cb7e-4fb5-8840-31cccbd377da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:43.021650 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-dde5014f-cb7e-4fb5-8840-31cccbd377da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:43.022834 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-dde5014f-cb7e-4fb5-8840-31cccbd377da tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.165320 May 12 14:36:43.024153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 361/699] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:42 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:43.476196 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f7d2ac6a-569e-41f7-a71e-1da472f75ed3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:43.476802 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f7d2ac6a-569e-41f7-a71e-1da472f75ed3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:43.484014 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f7d2ac6a-569e-41f7-a71e-1da472f75ed3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:43.484462 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f7d2ac6a-569e-41f7-a71e-1da472f75ed3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:43.485242 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f7d2ac6a-569e-41f7-a71e-1da472f75ed3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:43.485678 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f7d2ac6a-569e-41f7-a71e-1da472f75ed3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:43.614697 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f7d2ac6a-569e-41f7-a71e-1da472f75ed3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:43.622163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f7d2ac6a-569e-41f7-a71e-1da472f75ed3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.149785 May 12 14:36:43.622741 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 339/700] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:43 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:44.045815 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5df2b7ad-1f24-47f0-a80c-1897478027f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:44.046399 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5df2b7ad-1f24-47f0-a80c-1897478027f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:44.053244 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5df2b7ad-1f24-47f0-a80c-1897478027f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:44.053708 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5df2b7ad-1f24-47f0-a80c-1897478027f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:44.054510 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5df2b7ad-1f24-47f0-a80c-1897478027f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:44.054960 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5df2b7ad-1f24-47f0-a80c-1897478027f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:44.328673 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5df2b7ad-1f24-47f0-a80c-1897478027f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:44.337076 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5df2b7ad-1f24-47f0-a80c-1897478027f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:44.338593 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5df2b7ad-1f24-47f0-a80c-1897478027f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:44.339817 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5df2b7ad-1f24-47f0-a80c-1897478027f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.298089 May 12 14:36:44.340386 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 362/701] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:44 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:44.639018 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a1df89af-beaa-4617-adc0-b9ee1a7ea45d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:44.639656 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a1df89af-beaa-4617-adc0-b9ee1a7ea45d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:44.646072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a1df89af-beaa-4617-adc0-b9ee1a7ea45d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:44.646550 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a1df89af-beaa-4617-adc0-b9ee1a7ea45d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:44.647349 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a1df89af-beaa-4617-adc0-b9ee1a7ea45d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:44.647782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a1df89af-beaa-4617-adc0-b9ee1a7ea45d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:44.782305 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a1df89af-beaa-4617-adc0-b9ee1a7ea45d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:44.789562 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a1df89af-beaa-4617-adc0-b9ee1a7ea45d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.154391 May 12 14:36:44.790139 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 340/702] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:44 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:45.357736 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-db98ee70-2e7e-4e2d-bcc0-81b0a1d851f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:45.358363 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-db98ee70-2e7e-4e2d-bcc0-81b0a1d851f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:45.364823 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-db98ee70-2e7e-4e2d-bcc0-81b0a1d851f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:45.365287 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-db98ee70-2e7e-4e2d-bcc0-81b0a1d851f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:45.366079 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-db98ee70-2e7e-4e2d-bcc0-81b0a1d851f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:45.366534 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-db98ee70-2e7e-4e2d-bcc0-81b0a1d851f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:45.521651 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-db98ee70-2e7e-4e2d-bcc0-81b0a1d851f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:45.530841 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-db98ee70-2e7e-4e2d-bcc0-81b0a1d851f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:45.532420 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-db98ee70-2e7e-4e2d-bcc0-81b0a1d851f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:45.533597 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-db98ee70-2e7e-4e2d-bcc0-81b0a1d851f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.179828 May 12 14:36:45.534207 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 363/703] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:45 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:45.805997 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d2d1a5ff-fca1-411b-b28a-2eddeace1a5a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:45.806612 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d2d1a5ff-fca1-411b-b28a-2eddeace1a5a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:45.814314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d2d1a5ff-fca1-411b-b28a-2eddeace1a5a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:45.814782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d2d1a5ff-fca1-411b-b28a-2eddeace1a5a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:45.815588 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d2d1a5ff-fca1-411b-b28a-2eddeace1a5a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:45.816003 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d2d1a5ff-fca1-411b-b28a-2eddeace1a5a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:45.953769 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d2d1a5ff-fca1-411b-b28a-2eddeace1a5a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:45.964781 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d2d1a5ff-fca1-411b-b28a-2eddeace1a5a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.162534 May 12 14:36:45.965382 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 341/704] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:45 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:46.551728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e18ed723-55bc-45ac-afd6-acebd019e06a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:46.552386 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e18ed723-55bc-45ac-afd6-acebd019e06a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:46.558903 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e18ed723-55bc-45ac-afd6-acebd019e06a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:46.559397 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e18ed723-55bc-45ac-afd6-acebd019e06a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:46.560188 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e18ed723-55bc-45ac-afd6-acebd019e06a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:46.560635 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e18ed723-55bc-45ac-afd6-acebd019e06a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:46.685298 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e18ed723-55bc-45ac-afd6-acebd019e06a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:46.693749 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e18ed723-55bc-45ac-afd6-acebd019e06a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:46.695304 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e18ed723-55bc-45ac-afd6-acebd019e06a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:46.696469 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e18ed723-55bc-45ac-afd6-acebd019e06a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.148651 May 12 14:36:46.697096 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 364/705] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:46 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:46.981551 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9ef15fbb-7d84-488d-9820-3173de6f8097 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:46.982149 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9ef15fbb-7d84-488d-9820-3173de6f8097 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:46.989582 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9ef15fbb-7d84-488d-9820-3173de6f8097 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:46.990040 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9ef15fbb-7d84-488d-9820-3173de6f8097 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:46.990836 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9ef15fbb-7d84-488d-9820-3173de6f8097 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:46.991351 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9ef15fbb-7d84-488d-9820-3173de6f8097 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:47.128814 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9ef15fbb-7d84-488d-9820-3173de6f8097 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:47.136451 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9ef15fbb-7d84-488d-9820-3173de6f8097 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1371 microversion: 2.1 time: 0.158714 May 12 14:36:47.137034 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 342/706] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:46 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:36:47.715446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8fe39552-383c-4c04-b6ff-29a96e7949f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:47.716067 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8fe39552-383c-4c04-b6ff-29a96e7949f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:47.722390 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8fe39552-383c-4c04-b6ff-29a96e7949f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:47.722846 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8fe39552-383c-4c04-b6ff-29a96e7949f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:47.723651 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8fe39552-383c-4c04-b6ff-29a96e7949f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:47.724098 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8fe39552-383c-4c04-b6ff-29a96e7949f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:47.861369 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8fe39552-383c-4c04-b6ff-29a96e7949f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:47.869594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8fe39552-383c-4c04-b6ff-29a96e7949f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:47.871114 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8fe39552-383c-4c04-b6ff-29a96e7949f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:47.872282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8fe39552-383c-4c04-b6ff-29a96e7949f3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.160928 May 12 14:36:47.872841 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 365/707] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:47 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:48.152771 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-94abfec3-d0ad-4010-a249-b5f9862e9a8d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:48.153382 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-94abfec3-d0ad-4010-a249-b5f9862e9a8d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:48.159721 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-94abfec3-d0ad-4010-a249-b5f9862e9a8d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:48.160178 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-94abfec3-d0ad-4010-a249-b5f9862e9a8d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:48.160947 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-94abfec3-d0ad-4010-a249-b5f9862e9a8d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:48.161382 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-94abfec3-d0ad-4010-a249-b5f9862e9a8d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:48.292252 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-94abfec3-d0ad-4010-a249-b5f9862e9a8d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:48.300072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-94abfec3-d0ad-4010-a249-b5f9862e9a8d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1565 microversion: 2.1 time: 0.151114 May 12 14:36:48.300655 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 343/708] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:36:48 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:36:48.316855 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-104d6961-61d0-430c-aee0-1cb7d9bddc92 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:48.317354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-104d6961-61d0-430c-aee0-1cb7d9bddc92 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:48.323358 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-104d6961-61d0-430c-aee0-1cb7d9bddc92 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:48.323821 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-104d6961-61d0-430c-aee0-1cb7d9bddc92 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:48.324596 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-104d6961-61d0-430c-aee0-1cb7d9bddc92 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:48.325039 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-104d6961-61d0-430c-aee0-1cb7d9bddc92 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:48.404897 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-104d6961-61d0-430c-aee0-1cb7d9bddc92 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091756 May 12 14:36:48.405437 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 366/709] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 12 14:36:48 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:36:48.891862 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9be06061-62d5-4b29-8000-d857abded55b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:48.892482 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9be06061-62d5-4b29-8000-d857abded55b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:48.898826 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9be06061-62d5-4b29-8000-d857abded55b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:48.899318 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9be06061-62d5-4b29-8000-d857abded55b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:48.900122 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9be06061-62d5-4b29-8000-d857abded55b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:48.900563 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9be06061-62d5-4b29-8000-d857abded55b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:49.054147 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9be06061-62d5-4b29-8000-d857abded55b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:49.062577 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9be06061-62d5-4b29-8000-d857abded55b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:49.064124 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9be06061-62d5-4b29-8000-d857abded55b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:49.065309 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9be06061-62d5-4b29-8000-d857abded55b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.178045 May 12 14:36:49.065877 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 344/710] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:48 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:49.597266 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-fb6c4d9a-a352-4d64-98cc-f1dc6cb956a9 req-7ba959f0-a69e-4217-8f19-f011621928c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e40740-6dab-4657-abc3-eb83ee4b4c4d", "tag": "1d9bd042-8dc9-4559-9211-62f3a465dca4"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:36:49.605169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-fb6c4d9a-a352-4d64-98cc-f1dc6cb956a9 req-7ba959f0-a69e-4217-8f19-f011621928c8 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:49.605621 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-fb6c4d9a-a352-4d64-98cc-f1dc6cb956a9 req-7ba959f0-a69e-4217-8f19-f011621928c8 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:49.617024 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-fb6c4d9a-a352-4d64-98cc-f1dc6cb956a9 req-7ba959f0-a69e-4217-8f19-f011621928c8 service nova] Creating event network-changed:1d9bd042-8dc9-4559-9211-62f3a465dca4 for instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d on hv-cinder-77703 May 12 14:36:49.622011 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-fb6c4d9a-a352-4d64-98cc-f1dc6cb956a9 req-7ba959f0-a69e-4217-8f19-f011621928c8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028884 May 12 14:36:49.622775 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 367/711] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:36:50.083705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e34e5506-fb85-48f4-b1d6-4dc72365cc3a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:50.084338 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e34e5506-fb85-48f4-b1d6-4dc72365cc3a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:50.091430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e34e5506-fb85-48f4-b1d6-4dc72365cc3a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:50.091894 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e34e5506-fb85-48f4-b1d6-4dc72365cc3a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:50.093077 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e34e5506-fb85-48f4-b1d6-4dc72365cc3a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:50.093878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e34e5506-fb85-48f4-b1d6-4dc72365cc3a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:50.234877 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e34e5506-fb85-48f4-b1d6-4dc72365cc3a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:50.244069 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e34e5506-fb85-48f4-b1d6-4dc72365cc3a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:50.245592 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e34e5506-fb85-48f4-b1d6-4dc72365cc3a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:50.246782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e34e5506-fb85-48f4-b1d6-4dc72365cc3a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.167058 May 12 14:36:50.247405 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 345/712] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:50 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:51.275122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ce97291f-e658-45c4-a3bc-b2da2fe1f4bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:51.275753 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ce97291f-e658-45c4-a3bc-b2da2fe1f4bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:51.282619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ce97291f-e658-45c4-a3bc-b2da2fe1f4bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:51.283081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ce97291f-e658-45c4-a3bc-b2da2fe1f4bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:51.283868 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ce97291f-e658-45c4-a3bc-b2da2fe1f4bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:51.284312 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ce97291f-e658-45c4-a3bc-b2da2fe1f4bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:51.420194 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ce97291f-e658-45c4-a3bc-b2da2fe1f4bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:51.428410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ce97291f-e658-45c4-a3bc-b2da2fe1f4bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:51.429917 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ce97291f-e658-45c4-a3bc-b2da2fe1f4bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:51.431108 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ce97291f-e658-45c4-a3bc-b2da2fe1f4bd tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.160938 May 12 14:36:51.431675 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 368/713] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:51 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:52.461197 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b7673ca6-d2a2-4dba-995e-536cf9b0c307 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:52.461815 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b7673ca6-d2a2-4dba-995e-536cf9b0c307 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:52.468742 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b7673ca6-d2a2-4dba-995e-536cf9b0c307 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:52.469200 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b7673ca6-d2a2-4dba-995e-536cf9b0c307 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:52.469969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b7673ca6-d2a2-4dba-995e-536cf9b0c307 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:52.470412 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b7673ca6-d2a2-4dba-995e-536cf9b0c307 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:52.599475 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b7673ca6-d2a2-4dba-995e-536cf9b0c307 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:52.608580 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b7673ca6-d2a2-4dba-995e-536cf9b0c307 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:52.610104 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b7673ca6-d2a2-4dba-995e-536cf9b0c307 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:52.612166 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b7673ca6-d2a2-4dba-995e-536cf9b0c307 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.154002 May 12 14:36:52.612166 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 346/714] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:52 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:53.630990 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ad1ce555-555d-45af-a13e-e102493404f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:53.631664 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ad1ce555-555d-45af-a13e-e102493404f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:53.638172 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ad1ce555-555d-45af-a13e-e102493404f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:53.638628 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ad1ce555-555d-45af-a13e-e102493404f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:53.639439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ad1ce555-555d-45af-a13e-e102493404f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:53.639878 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ad1ce555-555d-45af-a13e-e102493404f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:53.836815 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ad1ce555-555d-45af-a13e-e102493404f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:53.845598 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ad1ce555-555d-45af-a13e-e102493404f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:53.847187 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ad1ce555-555d-45af-a13e-e102493404f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:53.849081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ad1ce555-555d-45af-a13e-e102493404f4 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.222159 May 12 14:36:53.860401 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 369/715] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:53 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:54.868982 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1adc2633-9337-4745-b537-8b04191f7254 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:54.869584 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1adc2633-9337-4745-b537-8b04191f7254 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:54.876831 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1adc2633-9337-4745-b537-8b04191f7254 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:54.877284 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1adc2633-9337-4745-b537-8b04191f7254 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:54.878070 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1adc2633-9337-4745-b537-8b04191f7254 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:54.878557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1adc2633-9337-4745-b537-8b04191f7254 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:55.010026 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1adc2633-9337-4745-b537-8b04191f7254 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:55.018716 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1adc2633-9337-4745-b537-8b04191f7254 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:55.020267 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1adc2633-9337-4745-b537-8b04191f7254 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:55.021538 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1adc2633-9337-4745-b537-8b04191f7254 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.156587 May 12 14:36:55.022130 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 347/716] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:54 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:56.039965 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a8150f7c-da03-4937-aa2a-151cd573be9b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:56.040591 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a8150f7c-da03-4937-aa2a-151cd573be9b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:56.047699 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8150f7c-da03-4937-aa2a-151cd573be9b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:56.048163 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8150f7c-da03-4937-aa2a-151cd573be9b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:56.048948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8150f7c-da03-4937-aa2a-151cd573be9b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:56.049396 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8150f7c-da03-4937-aa2a-151cd573be9b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:56.178780 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a8150f7c-da03-4937-aa2a-151cd573be9b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:56.187024 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a8150f7c-da03-4937-aa2a-151cd573be9b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:56.188549 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a8150f7c-da03-4937-aa2a-151cd573be9b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:56.189712 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a8150f7c-da03-4937-aa2a-151cd573be9b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.153703 May 12 14:36:56.190276 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 370/717] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:56 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:57.207800 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-058758eb-25ae-4e60-a4d2-51a79d115788 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:57.208419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-058758eb-25ae-4e60-a4d2-51a79d115788 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:57.214727 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-058758eb-25ae-4e60-a4d2-51a79d115788 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:57.215276 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-058758eb-25ae-4e60-a4d2-51a79d115788 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:57.216002 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-058758eb-25ae-4e60-a4d2-51a79d115788 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:57.216447 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-058758eb-25ae-4e60-a4d2-51a79d115788 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:57.342861 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-058758eb-25ae-4e60-a4d2-51a79d115788 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:57.350979 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-058758eb-25ae-4e60-a4d2-51a79d115788 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:57.352514 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-058758eb-25ae-4e60-a4d2-51a79d115788 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:57.353672 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-058758eb-25ae-4e60-a4d2-51a79d115788 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.149812 May 12 14:36:57.354233 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 348/718] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:57 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:58.371960 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ecfa5446-8bf9-44ae-b74e-3abf6275a56f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:58.372576 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ecfa5446-8bf9-44ae-b74e-3abf6275a56f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:58.379632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ecfa5446-8bf9-44ae-b74e-3abf6275a56f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:58.380090 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ecfa5446-8bf9-44ae-b74e-3abf6275a56f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:58.380852 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ecfa5446-8bf9-44ae-b74e-3abf6275a56f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:58.381293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ecfa5446-8bf9-44ae-b74e-3abf6275a56f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:58.506573 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ecfa5446-8bf9-44ae-b74e-3abf6275a56f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:58.515343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ecfa5446-8bf9-44ae-b74e-3abf6275a56f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:58.516863 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ecfa5446-8bf9-44ae-b74e-3abf6275a56f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:58.518034 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ecfa5446-8bf9-44ae-b74e-3abf6275a56f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.149959 May 12 14:36:58.518604 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 371/719] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:58 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:36:59.536514 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a7ad799c-8a80-457a-836f-27190ccd3f06 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:36:59.537118 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a7ad799c-8a80-457a-836f-27190ccd3f06 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:36:59.543693 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a7ad799c-8a80-457a-836f-27190ccd3f06 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:59.544148 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a7ad799c-8a80-457a-836f-27190ccd3f06 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:59.545457 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a7ad799c-8a80-457a-836f-27190ccd3f06 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:36:59.545895 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a7ad799c-8a80-457a-836f-27190ccd3f06 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:36:59.678095 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a7ad799c-8a80-457a-836f-27190ccd3f06 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:59.686438 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a7ad799c-8a80-457a-836f-27190ccd3f06 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:59.687970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a7ad799c-8a80-457a-836f-27190ccd3f06 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:36:59.689129 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a7ad799c-8a80-457a-836f-27190ccd3f06 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.156539 May 12 14:36:59.689693 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 349/720] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:36:59 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:37:00.031087 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-4a29dba3-8f69-4868-b5dd-331719abf76a req-6c10c8b2-5a72-4da6-aef5-f388ad20dd55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e2a4c2-6255-4074-9a3c-e5159c3f7b87", "name": "network-vif-plugged", "status": "completed", "tag": "7fccb52d-a09a-4e64-adbe-8b42348d39c5"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:37:00.040521 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-4a29dba3-8f69-4868-b5dd-331719abf76a req-6c10c8b2-5a72-4da6-aef5-f388ad20dd55 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:00.040970 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-4a29dba3-8f69-4868-b5dd-331719abf76a req-6c10c8b2-5a72-4da6-aef5-f388ad20dd55 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:00.053196 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-4a29dba3-8f69-4868-b5dd-331719abf76a req-6c10c8b2-5a72-4da6-aef5-f388ad20dd55 service nova] Creating event network-vif-plugged:7fccb52d-a09a-4e64-adbe-8b42348d39c5 for instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 on hv-cinder-77703 May 12 14:37:00.058624 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-4a29dba3-8f69-4868-b5dd-331719abf76a req-6c10c8b2-5a72-4da6-aef5-f388ad20dd55 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031739 May 12 14:37:00.059278 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 372/721] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:37:00.707814 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2b3574f1-3166-44ef-a2c4-c466ed7ea4b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:00.708497 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2b3574f1-3166-44ef-a2c4-c466ed7ea4b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:00.714855 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2b3574f1-3166-44ef-a2c4-c466ed7ea4b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:00.715340 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2b3574f1-3166-44ef-a2c4-c466ed7ea4b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:00.716124 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2b3574f1-3166-44ef-a2c4-c466ed7ea4b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:00.716573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2b3574f1-3166-44ef-a2c4-c466ed7ea4b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:00.844242 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2b3574f1-3166-44ef-a2c4-c466ed7ea4b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:00.852553 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2b3574f1-3166-44ef-a2c4-c466ed7ea4b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:00.854065 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2b3574f1-3166-44ef-a2c4-c466ed7ea4b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:00.855254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2b3574f1-3166-44ef-a2c4-c466ed7ea4b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.151308 May 12 14:37:00.855831 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 350/722] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:37:00 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:37:01.876637 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-088293e4-5cca-4ef5-9e7f-7302f8931eb8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:01.877376 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-088293e4-5cca-4ef5-9e7f-7302f8931eb8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:01.883620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-088293e4-5cca-4ef5-9e7f-7302f8931eb8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:01.884076 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-088293e4-5cca-4ef5-9e7f-7302f8931eb8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:01.884858 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-088293e4-5cca-4ef5-9e7f-7302f8931eb8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:01.885301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-088293e4-5cca-4ef5-9e7f-7302f8931eb8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:02.019798 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-088293e4-5cca-4ef5-9e7f-7302f8931eb8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:02.028294 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-088293e4-5cca-4ef5-9e7f-7302f8931eb8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:02.030381 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-088293e4-5cca-4ef5-9e7f-7302f8931eb8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:02.031595 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-088293e4-5cca-4ef5-9e7f-7302f8931eb8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.160816 May 12 14:37:02.032168 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 373/723] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:37:01 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:37:03.049580 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-07162ec9-5790-41f8-bb64-9296c249adc8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:03.050186 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-07162ec9-5790-41f8-bb64-9296c249adc8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:03.056700 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-07162ec9-5790-41f8-bb64-9296c249adc8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:03.057149 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-07162ec9-5790-41f8-bb64-9296c249adc8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:03.057915 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-07162ec9-5790-41f8-bb64-9296c249adc8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:03.058345 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-07162ec9-5790-41f8-bb64-9296c249adc8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:03.186899 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-07162ec9-5790-41f8-bb64-9296c249adc8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:03.198651 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-07162ec9-5790-41f8-bb64-9296c249adc8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:03.200216 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-07162ec9-5790-41f8-bb64-9296c249adc8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:03.201934 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-07162ec9-5790-41f8-bb64-9296c249adc8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.156296 May 12 14:37:03.202502 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 351/724] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:37:03 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:37:04.220873 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3132afee-1108-42cd-8634-38717adab179 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:04.221449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3132afee-1108-42cd-8634-38717adab179 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:04.227862 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3132afee-1108-42cd-8634-38717adab179 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:04.228324 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3132afee-1108-42cd-8634-38717adab179 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:04.229103 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3132afee-1108-42cd-8634-38717adab179 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:04.229550 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3132afee-1108-42cd-8634-38717adab179 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:04.363161 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3132afee-1108-42cd-8634-38717adab179 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:04.371767 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3132afee-1108-42cd-8634-38717adab179 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:04.374109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3132afee-1108-42cd-8634-38717adab179 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:04.375336 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3132afee-1108-42cd-8634-38717adab179 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.159122 May 12 14:37:04.375913 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 374/725] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:37:04 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:37:05.393904 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b331d536-077f-4507-8af5-d54df894508c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:05.394553 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b331d536-077f-4507-8af5-d54df894508c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:05.400968 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b331d536-077f-4507-8af5-d54df894508c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:05.401423 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b331d536-077f-4507-8af5-d54df894508c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:05.402199 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b331d536-077f-4507-8af5-d54df894508c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:05.402647 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b331d536-077f-4507-8af5-d54df894508c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:05.543975 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b331d536-077f-4507-8af5-d54df894508c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:05.555011 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b331d536-077f-4507-8af5-d54df894508c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:05.556638 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b331d536-077f-4507-8af5-d54df894508c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:05.557823 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b331d536-077f-4507-8af5-d54df894508c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.167872 May 12 14:37:05.558525 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 352/726] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:37:05 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:37:06.577109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ca0e6dad-5123-4837-97ca-6b4199d8c863 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:06.577713 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ca0e6dad-5123-4837-97ca-6b4199d8c863 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:06.584199 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ca0e6dad-5123-4837-97ca-6b4199d8c863 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:06.584658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ca0e6dad-5123-4837-97ca-6b4199d8c863 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:06.585435 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ca0e6dad-5123-4837-97ca-6b4199d8c863 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:06.585880 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ca0e6dad-5123-4837-97ca-6b4199d8c863 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:06.730016 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ca0e6dad-5123-4837-97ca-6b4199d8c863 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:06.738366 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ca0e6dad-5123-4837-97ca-6b4199d8c863 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:06.739906 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ca0e6dad-5123-4837-97ca-6b4199d8c863 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:06.741074 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ca0e6dad-5123-4837-97ca-6b4199d8c863 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.167883 May 12 14:37:06.741636 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 375/727] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:37:06 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:37:07.760010 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2c54871d-1925-4c2f-b17b-c842cf5a547c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:07.760651 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2c54871d-1925-4c2f-b17b-c842cf5a547c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:07.767871 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c54871d-1925-4c2f-b17b-c842cf5a547c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:07.768353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c54871d-1925-4c2f-b17b-c842cf5a547c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:07.769131 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c54871d-1925-4c2f-b17b-c842cf5a547c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:07.769569 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c54871d-1925-4c2f-b17b-c842cf5a547c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:07.899235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2c54871d-1925-4c2f-b17b-c842cf5a547c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:07.908191 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2c54871d-1925-4c2f-b17b-c842cf5a547c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:07.909709 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2c54871d-1925-4c2f-b17b-c842cf5a547c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:07.910884 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2c54871d-1925-4c2f-b17b-c842cf5a547c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.154859 May 12 14:37:07.911493 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 353/728] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:37:07 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:37:08.929318 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e0d548e0-0839-432d-8789-1b8e8cd1210e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:08.929963 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e0d548e0-0839-432d-8789-1b8e8cd1210e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:08.936915 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e0d548e0-0839-432d-8789-1b8e8cd1210e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:08.937378 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e0d548e0-0839-432d-8789-1b8e8cd1210e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:08.938162 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e0d548e0-0839-432d-8789-1b8e8cd1210e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:08.938606 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e0d548e0-0839-432d-8789-1b8e8cd1210e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:09.072111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e0d548e0-0839-432d-8789-1b8e8cd1210e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:09.081529 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e0d548e0-0839-432d-8789-1b8e8cd1210e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:09.083170 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e0d548e0-0839-432d-8789-1b8e8cd1210e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:09.084536 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e0d548e0-0839-432d-8789-1b8e8cd1210e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.159154 May 12 14:37:09.085108 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 376/729] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:37:08 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:37:10.102803 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b7479d31-1409-4ca0-8ee7-54f435c4c452 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:10.103443 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b7479d31-1409-4ca0-8ee7-54f435c4c452 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:10.109826 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b7479d31-1409-4ca0-8ee7-54f435c4c452 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:10.110280 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b7479d31-1409-4ca0-8ee7-54f435c4c452 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:10.111067 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b7479d31-1409-4ca0-8ee7-54f435c4c452 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:10.111562 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b7479d31-1409-4ca0-8ee7-54f435c4c452 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:10.250335 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b7479d31-1409-4ca0-8ee7-54f435c4c452 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:10.259197 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b7479d31-1409-4ca0-8ee7-54f435c4c452 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:10.260924 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b7479d31-1409-4ca0-8ee7-54f435c4c452 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:10.262415 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b7479d31-1409-4ca0-8ee7-54f435c4c452 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1807 microversion: 2.20 time: 0.163434 May 12 14:37:10.263911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 354/730] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:37:10 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:37:11.281851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-30a13540-af11-45e1-81d6-7879a810042f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:11.282472 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-30a13540-af11-45e1-81d6-7879a810042f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:11.289472 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-30a13540-af11-45e1-81d6-7879a810042f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:11.290007 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-30a13540-af11-45e1-81d6-7879a810042f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:11.291055 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-30a13540-af11-45e1-81d6-7879a810042f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:11.291680 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-30a13540-af11-45e1-81d6-7879a810042f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:11.420999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-30a13540-af11-45e1-81d6-7879a810042f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:11.429188 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-30a13540-af11-45e1-81d6-7879a810042f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:11.430703 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-30a13540-af11-45e1-81d6-7879a810042f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:11.431896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-30a13540-af11-45e1-81d6-7879a810042f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1794 microversion: 2.20 time: 0.154814 May 12 14:37:11.432461 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 377/731] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:37:11 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:37:12.339694 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3fafde8f-580a-4ef3-b484-bca296c4af2e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:12.340194 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3fafde8f-580a-4ef3-b484-bca296c4af2e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:12.347163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3fafde8f-580a-4ef3-b484-bca296c4af2e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:12.347620 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3fafde8f-580a-4ef3-b484-bca296c4af2e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:12.348524 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3fafde8f-580a-4ef3-b484-bca296c4af2e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:12.348904 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3fafde8f-580a-4ef3-b484-bca296c4af2e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:12.472773 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-3fafde8f-580a-4ef3-b484-bca296c4af2e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lazy-loading 'services' on Instance uuid 03ea87fc-19a5-4d9e-b6c3-7b464c75d052 {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:37:12.585432 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3fafde8f-580a-4ef3-b484-bca296c4af2e tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "DELETE /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052/os-volume_attachments/a0976804-6dff-4ace-bd92-72de104e4ffc" status: 202 len: 0 microversion: 2.1 time: 0.249450 May 12 14:37:12.586098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 355/732] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 12 14:37:12 2022] DELETE /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052/os-volume_attachments/a0976804-6dff-4ace-bd92-72de104e4ffc => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:37:14.750707 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-531e355f-4667-4556-a405-05f2b41617d1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:14.751331 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-531e355f-4667-4556-a405-05f2b41617d1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:14.757948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-531e355f-4667-4556-a405-05f2b41617d1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:14.758404 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-531e355f-4667-4556-a405-05f2b41617d1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:14.759244 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-531e355f-4667-4556-a405-05f2b41617d1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:14.759691 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-531e355f-4667-4556-a405-05f2b41617d1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:14.785516 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-531e355f-4667-4556-a405-05f2b41617d1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Going to try to terminate instance {{(pid=118217) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:37:14.864846 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-531e355f-4667-4556-a405-05f2b41617d1 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "DELETE /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 204 len: 0 microversion: 2.1 time: 0.118590 May 12 14:37:14.865550 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 378/733] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:37:14 2022] DELETE /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:37:14.875179 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0b99d831-d140-4462-88d6-90d1d507b331 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:14.875875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0b99d831-d140-4462-88d6-90d1d507b331 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:14.882497 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0b99d831-d140-4462-88d6-90d1d507b331 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:14.882943 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0b99d831-d140-4462-88d6-90d1d507b331 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:14.883755 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0b99d831-d140-4462-88d6-90d1d507b331 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:14.885207 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0b99d831-d140-4462-88d6-90d1d507b331 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:15.024296 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0b99d831-d140-4462-88d6-90d1d507b331 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:15.032511 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0b99d831-d140-4462-88d6-90d1d507b331 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1513 microversion: 2.1 time: 0.162218 May 12 14:37:15.033104 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 356/734] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:37:14 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:16.051236 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-009ee297-40a2-46cb-aad4-76b9195e247d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:16.051847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-009ee297-40a2-46cb-aad4-76b9195e247d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:16.058134 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-009ee297-40a2-46cb-aad4-76b9195e247d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:16.058588 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-009ee297-40a2-46cb-aad4-76b9195e247d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:16.059393 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-009ee297-40a2-46cb-aad4-76b9195e247d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:16.059833 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-009ee297-40a2-46cb-aad4-76b9195e247d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:16.191871 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-009ee297-40a2-46cb-aad4-76b9195e247d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:16.199140 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-009ee297-40a2-46cb-aad4-76b9195e247d tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1513 microversion: 2.1 time: 0.152181 May 12 14:37:16.199725 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 379/735] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:37:16 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:17.217023 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-57a8fdef-7feb-4035-987e-746ba414e158 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:17.217610 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-57a8fdef-7feb-4035-987e-746ba414e158 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:17.224074 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57a8fdef-7feb-4035-987e-746ba414e158 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:17.224518 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57a8fdef-7feb-4035-987e-746ba414e158 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:17.225286 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57a8fdef-7feb-4035-987e-746ba414e158 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:17.225723 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57a8fdef-7feb-4035-987e-746ba414e158 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:17.363546 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-57a8fdef-7feb-4035-987e-746ba414e158 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:17.371174 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-57a8fdef-7feb-4035-987e-746ba414e158 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1513 microversion: 2.1 time: 0.158638 May 12 14:37:17.371755 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 357/736] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:37:17 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:18.389145 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-62b5ea21-a4db-4b4d-bc86-f2c6a89af398 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:18.389825 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-62b5ea21-a4db-4b4d-bc86-f2c6a89af398 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:18.396268 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-62b5ea21-a4db-4b4d-bc86-f2c6a89af398 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:18.396725 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-62b5ea21-a4db-4b4d-bc86-f2c6a89af398 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:18.397504 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-62b5ea21-a4db-4b4d-bc86-f2c6a89af398 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:18.397938 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-62b5ea21-a4db-4b4d-bc86-f2c6a89af398 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:18.609569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-62b5ea21-a4db-4b4d-bc86-f2c6a89af398 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:18.617731 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-62b5ea21-a4db-4b4d-bc86-f2c6a89af398 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1513 microversion: 2.1 time: 0.231887 May 12 14:37:18.618366 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 380/737] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:37:18 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:19.340447 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-57a5f094-6cac-49d0-a0a5-a5676242ab81 req-07442c1b-a5d4-4088-bbc9-d2586df66c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ea87fc-19a5-4d9e-b6c3-7b464c75d052", "name": "network-vif-deleted", "tag": "1a2cb385-3a41-4cfb-a347-2f9ef44bca18"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:37:19.354126 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-57a5f094-6cac-49d0-a0a5-a5676242ab81 req-07442c1b-a5d4-4088-bbc9-d2586df66c04 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:19.354575 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-57a5f094-6cac-49d0-a0a5-a5676242ab81 req-07442c1b-a5d4-4088-bbc9-d2586df66c04 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:19.366258 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-57a5f094-6cac-49d0-a0a5-a5676242ab81 req-07442c1b-a5d4-4088-bbc9-d2586df66c04 service nova] Creating event network-vif-deleted:1a2cb385-3a41-4cfb-a347-2f9ef44bca18 for instance 03ea87fc-19a5-4d9e-b6c3-7b464c75d052 on hv-cinder-77703 May 12 14:37:19.371509 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-57a5f094-6cac-49d0-a0a5-a5676242ab81 req-07442c1b-a5d4-4088-bbc9-d2586df66c04 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100021 May 12 14:37:19.372497 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 358/738] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:37:19.634784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-865dc0d7-be82-4a10-b24b-e258acfee9e3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:19.635441 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-865dc0d7-be82-4a10-b24b-e258acfee9e3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:19.642430 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-865dc0d7-be82-4a10-b24b-e258acfee9e3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:19.642882 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-865dc0d7-be82-4a10-b24b-e258acfee9e3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:19.643732 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-865dc0d7-be82-4a10-b24b-e258acfee9e3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:19.644176 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-865dc0d7-be82-4a10-b24b-e258acfee9e3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:19.676332 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-865dc0d7-be82-4a10-b24b-e258acfee9e3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:19.676842 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-865dc0d7-be82-4a10-b24b-e258acfee9e3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:19.677308 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-865dc0d7-be82-4a10-b24b-e258acfee9e3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lazy-loading 'fault' on Instance uuid 03ea87fc-19a5-4d9e-b6c3-7b464c75d052 {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:37:19.717853 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-865dc0d7-be82-4a10-b24b-e258acfee9e3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fa3252d9f04964b481dd02b378d072', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9501c41f0664eca9177e0071bb5b1b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:37:19.725323 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-865dc0d7-be82-4a10-b24b-e258acfee9e3 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 200 len: 1308 microversion: 2.1 time: 0.094516 May 12 14:37:19.725902 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 381/739] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:37:19 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:37:20.743814 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ebbfd41d-ef18-4a20-bd9e-c3b157374ce8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:37:20.744512 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ebbfd41d-ef18-4a20-bd9e-c3b157374ce8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] [instance: 03ea87fc-19a5-4d9e-b6c3-7b464c75d052] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:37:20.751469 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ebbfd41d-ef18-4a20-bd9e-c3b157374ce8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:20.752009 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ebbfd41d-ef18-4a20-bd9e-c3b157374ce8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:20.753743 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ebbfd41d-ef18-4a20-bd9e-c3b157374ce8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:37:20.754181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ebbfd41d-ef18-4a20-bd9e-c3b157374ce8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:37:20.766970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-ebbfd41d-ef18-4a20-bd9e-c3b157374ce8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] HTTP exception thrown: Instance 03ea87fc-19a5-4d9e-b6c3-7b464c75d052 could not be found. May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ebbfd41d-ef18-4a20-bd9e-c3b157374ce8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Request method failure captured: May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 HTTP/1.1 May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRqsWAEGZuxoA-K0Y3vTihgfklS0yybGiIsXvVk6XA5PwDj_2ys0ol7c81R681FyH-HhHGyGJDqovmIj1P02GWCk-YXwIaasAx7zc8T7NKZyXbHG5xpQ5W3xzRsCYv_a9zof1VsgjbQD8-NksyDl_z55nYyxya_VOfeeZ1xsTW239pk May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: a9501c41f0664eca9177e0071bb5b1b8 May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1036433163 May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:37:20.768782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:37:20.771312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/a9501c41f0664eca9177e0071bb5b1b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9501c41f0664eca9177e0071bb5b1b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_a9501c41f0664eca9177e0071bb5b1b8", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/a9501c41f0664eca9177e0071bb5b1b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:37:20.771312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-VolumesSnapshotTestJSON-1036433163 May 12 14:37:20.771312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: a9501c41f0664eca9177e0071bb5b1b8 May 12 14:37:20.771312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1036433163 May 12 14:37:20.771312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-VolumesSnapshotTestJSON-1036433163-project May 12 14:37:20.771312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:37:20.771312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:37:20.771312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: e6fa3252d9f04964b481dd02b378d072 May 12 14:37:20.771312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-VolumesSnapshotTestJSON-1036433163-project May 12 14:37:20.771312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:37:20.771312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance 03ea87fc-19a5-4d9e-b6c3-7b464c75d052 could not be found. May 12 14:37:20.771312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '03ea87fc-19a5-4d9e-b6c3-7b464c75d052'} May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ea87fc-19a5-4d9e-b6c3-7b464c75d052 could not be found. May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:37:20.772279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ea87fc-19a5-4d9e-b6c3-7b464c75d052 could not be found. May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ea87fc-19a5-4d9e-b6c3-7b464c75d052 could not be found. May 12 14:37:20.774843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:37:20.777829 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ebbfd41d-ef18-4a20-bd9e-c3b157374ce8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] Returning 404 to user: Instance 03ea87fc-19a5-4d9e-b6c3-7b464c75d052 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:37:20.777829 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ebbfd41d-ef18-4a20-bd9e-c3b157374ce8 tempest-VolumesSnapshotTestJSON-1036433163 tempest-VolumesSnapshotTestJSON-1036433163-project] 10.222.0.75 "GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052" status: 404 len: 111 microversion: 2.1 time: 0.031092 May 12 14:37:20.777829 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 359/740] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:37:20 2022] GET /compute/v2.1/servers/03ea87fc-19a5-4d9e-b6c3-7b464c75d052 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:38:02.449291 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-425a150c-7724-43f7-b8bc-a1ba08b32f42 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:02.450885 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-425a150c-7724-43f7-b8bc-a1ba08b32f42 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:02.462306 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-425a150c-7724-43f7-b8bc-a1ba08b32f42 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:02.462895 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-425a150c-7724-43f7-b8bc-a1ba08b32f42 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:02.463798 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-425a150c-7724-43f7-b8bc-a1ba08b32f42 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:02.464468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-425a150c-7724-43f7-b8bc-a1ba08b32f42 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:02.490789 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-425a150c-7724-43f7-b8bc-a1ba08b32f42 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1/ips" status: 200 len: 149 microversion: 2.1 time: 0.259455 May 12 14:38:02.491499 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 382/741] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 12 14:38:02 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1/ips => generated 149 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:02.503307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4055187d-7da5-42f1-a7fa-3db3968b239c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97e190c3-d77e-4998-b3c6-42aad50a898c"}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:02.505558 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4055187d-7da5-42f1-a7fa-3db3968b239c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:02.511926 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4055187d-7da5-42f1-a7fa-3db3968b239c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:02.512670 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4055187d-7da5-42f1-a7fa-3db3968b239c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:02.513602 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4055187d-7da5-42f1-a7fa-3db3968b239c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:02.514352 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4055187d-7da5-42f1-a7fa-3db3968b239c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:02.641719 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-4055187d-7da5-42f1-a7fa-3db3968b239c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] HTTP exception thrown: Invalid volume: volume 97e190c3-d77e-4998-b3c6-42aad50a898c is already attached to instances: 1fab0a31-9c59-40c0-8350-788bf0458078 May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4055187d-7da5-42f1-a7fa-3db3968b239c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Request method failure captured: May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: POST /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1/os-volume_attachments HTTP/1.1 May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 74 May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRo-ycWfHqPPxbmLiuTXrtXJLZwYU78oTuGhPDkiQSHU7CKcy_GQqpZ_HWFwpOkfP_a2cy2OZwfawJtQIkHx1tZyLxJZoQOwjSpujcF6pQ0BcV3O7kKLbSCm6-7BGei9mU5XP-t1FCFU5rK_O_aRKcjHsdbD5yR-8mP9_YNetCjLQkw May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:38:02.643668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:38:02.645389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4b5ca018b5f4dda99486407424b8168", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:38:02.645389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-AttachVolumeNegativeTest-523912070 May 12 14:38:02.645389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:38:02.645389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:38:02.645389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:38:02.645389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:38:02.645389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:38:02.645389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: c6422873a3b84aac88f8a93291bcd7b0 May 12 14:38:02.645389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:38:02.645389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: May 12 14:38:02.645389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {"volumeAttachment": {"volumeId": "97e190c3-d77e-4998-b3c6-42aad50a898c"}} May 12 14:38:02.645389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Invalid volume: volume 97e190c3-d77e-4998-b3c6-42aad50a898c is already attached to instances: 1fab0a31-9c59-40c0-8350-788bf0458078 May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'server_id': '6a95d03a-223b-49bc-ba3a-afc4119c02c1', 'body': {'volumeAttachment': {'volumeId': '97e190c3-d77e-4998-b3c6-42aad50a898c'}}} May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 97e190c3-d77e-4998-b3c6-42aad50a898c is already attached to instances: 1fab0a31-9c59-40c0-8350-788bf0458078 May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:38:02.646314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 97e190c3-d77e-4998-b3c6-42aad50a898c is already attached to instances: 1fab0a31-9c59-40c0-8350-788bf0458078 May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:02.647756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:02.649193 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:02.649193 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:38:02.649193 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:38:02.649193 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 97e190c3-d77e-4998-b3c6-42aad50a898c is already attached to instances: 1fab0a31-9c59-40c0-8350-788bf0458078 May 12 14:38:02.649193 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:38:02.650234 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4055187d-7da5-42f1-a7fa-3db3968b239c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Returning 400 to user: Invalid volume: volume 97e190c3-d77e-4998-b3c6-42aad50a898c is already attached to instances: 1fab0a31-9c59-40c0-8350-788bf0458078 {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:38:02.654325 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4055187d-7da5-42f1-a7fa-3db3968b239c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "POST /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.153921 May 12 14:38:02.655145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 360/742] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 12 14:38:02 2022] POST /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1/os-volume_attachments => generated 174 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 12 14:38:02.664103 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-768e9dca-f451-4697-ba54-88167147f423 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:02.664810 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-768e9dca-f451-4697-ba54-88167147f423 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:02.674457 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-768e9dca-f451-4697-ba54-88167147f423 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:02.674817 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-768e9dca-f451-4697-ba54-88167147f423 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:02.675636 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-768e9dca-f451-4697-ba54-88167147f423 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:02.676096 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-768e9dca-f451-4697-ba54-88167147f423 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:02.705397 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-768e9dca-f451-4697-ba54-88167147f423 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Going to try to terminate instance {{(pid=118217) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:38:02.835453 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-768e9dca-f451-4697-ba54-88167147f423 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 204 len: 0 microversion: 2.1 time: 0.174052 May 12 14:38:02.837515 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 383/743] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:38:02 2022] DELETE /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:38:02.848573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ce699cb5-a30b-418c-b976-a4c0a9ef8ee7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:02.849430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ce699cb5-a30b-418c-b976-a4c0a9ef8ee7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:02.857393 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ce699cb5-a30b-418c-b976-a4c0a9ef8ee7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:02.857837 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ce699cb5-a30b-418c-b976-a4c0a9ef8ee7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:02.858868 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ce699cb5-a30b-418c-b976-a4c0a9ef8ee7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:02.859533 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ce699cb5-a30b-418c-b976-a4c0a9ef8ee7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:03.077138 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ce699cb5-a30b-418c-b976-a4c0a9ef8ee7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:03.092883 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ce699cb5-a30b-418c-b976-a4c0a9ef8ee7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1679 microversion: 2.1 time: 0.252110 May 12 14:38:03.093617 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 361/744] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:02 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1679 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:03.996317 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2b4870f1-30ad-4bf6-9e84-629ba96c23ad tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:03.997782 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2b4870f1-30ad-4bf6-9e84-629ba96c23ad tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:04.006465 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2b4870f1-30ad-4bf6-9e84-629ba96c23ad tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:04.007217 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2b4870f1-30ad-4bf6-9e84-629ba96c23ad tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:04.008312 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2b4870f1-30ad-4bf6-9e84-629ba96c23ad tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:04.009301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2b4870f1-30ad-4bf6-9e84-629ba96c23ad tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:04.048367 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2b4870f1-30ad-4bf6-9e84-629ba96c23ad tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Going to try to terminate instance {{(pid=118217) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:38:04.113005 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c93e39d6-53ad-45cf-b5e1-b77a74716166 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:04.113555 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c93e39d6-53ad-45cf-b5e1-b77a74716166 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:04.131603 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c93e39d6-53ad-45cf-b5e1-b77a74716166 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:04.133186 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c93e39d6-53ad-45cf-b5e1-b77a74716166 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:04.133186 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c93e39d6-53ad-45cf-b5e1-b77a74716166 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:04.133391 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c93e39d6-53ad-45cf-b5e1-b77a74716166 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:04.208572 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2b4870f1-30ad-4bf6-9e84-629ba96c23ad tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 204 len: 0 microversion: 2.1 time: 0.217223 May 12 14:38:04.212871 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 384/745] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:38:03 2022] DELETE /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:38:04.220074 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-99811552-5509-4a40-a9d6-caace9de1bb8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:04.220851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-99811552-5509-4a40-a9d6-caace9de1bb8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:04.227980 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-99811552-5509-4a40-a9d6-caace9de1bb8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:04.228489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-99811552-5509-4a40-a9d6-caace9de1bb8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:04.229454 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-99811552-5509-4a40-a9d6-caace9de1bb8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:04.230181 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-99811552-5509-4a40-a9d6-caace9de1bb8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:04.393663 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c93e39d6-53ad-45cf-b5e1-b77a74716166 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:04.401557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c93e39d6-53ad-45cf-b5e1-b77a74716166 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1679 microversion: 2.1 time: 0.292989 May 12 14:38:04.402133 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 362/746] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:04 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1679 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:04.435709 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-99811552-5509-4a40-a9d6-caace9de1bb8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:04.443379 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-99811552-5509-4a40-a9d6-caace9de1bb8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1579 microversion: 2.1 time: 0.229429 May 12 14:38:04.444160 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 385/747] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:04 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1579 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:05.419521 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9c85406e-16be-4257-b3da-555f685c6d11 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:05.421413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9c85406e-16be-4257-b3da-555f685c6d11 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:05.430312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9c85406e-16be-4257-b3da-555f685c6d11 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:05.431067 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9c85406e-16be-4257-b3da-555f685c6d11 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:05.432025 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9c85406e-16be-4257-b3da-555f685c6d11 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:05.432462 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9c85406e-16be-4257-b3da-555f685c6d11 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:05.460745 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9964f780-9e4d-43a9-a361-eddb3ab878b7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:05.461369 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9964f780-9e4d-43a9-a361-eddb3ab878b7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:05.475177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9964f780-9e4d-43a9-a361-eddb3ab878b7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:05.479134 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9964f780-9e4d-43a9-a361-eddb3ab878b7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:05.480040 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9964f780-9e4d-43a9-a361-eddb3ab878b7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:05.480491 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9964f780-9e4d-43a9-a361-eddb3ab878b7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:05.671175 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9c85406e-16be-4257-b3da-555f685c6d11 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:05.681232 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9c85406e-16be-4257-b3da-555f685c6d11 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1679 microversion: 2.1 time: 0.265118 May 12 14:38:05.682084 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 363/748] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:05 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1679 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:05.727988 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9964f780-9e4d-43a9-a361-eddb3ab878b7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:05.740111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9964f780-9e4d-43a9-a361-eddb3ab878b7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1579 microversion: 2.1 time: 0.283213 May 12 14:38:05.740978 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 386/749] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:05 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1579 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:06.709241 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4366df16-5207-41d7-a612-5ce3e57b59c8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:06.710761 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4366df16-5207-41d7-a612-5ce3e57b59c8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:06.718227 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4366df16-5207-41d7-a612-5ce3e57b59c8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:06.719215 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4366df16-5207-41d7-a612-5ce3e57b59c8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:06.721996 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4366df16-5207-41d7-a612-5ce3e57b59c8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:06.722791 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4366df16-5207-41d7-a612-5ce3e57b59c8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:06.757662 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-02d7ddd0-9bab-4fc4-9b3b-072d0478972b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:06.758811 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-02d7ddd0-9bab-4fc4-9b3b-072d0478972b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:06.764856 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-02d7ddd0-9bab-4fc4-9b3b-072d0478972b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:06.765365 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-02d7ddd0-9bab-4fc4-9b3b-072d0478972b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:06.766670 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-02d7ddd0-9bab-4fc4-9b3b-072d0478972b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:06.767140 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-02d7ddd0-9bab-4fc4-9b3b-072d0478972b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:07.268169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-02d7ddd0-9bab-4fc4-9b3b-072d0478972b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:07.283172 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-02d7ddd0-9bab-4fc4-9b3b-072d0478972b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1579 microversion: 2.1 time: 0.529037 May 12 14:38:07.294657 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4366df16-5207-41d7-a612-5ce3e57b59c8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:07.296100 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 387/750] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:06 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1579 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:07.303106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4366df16-5207-41d7-a612-5ce3e57b59c8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1679 microversion: 2.1 time: 0.602087 May 12 14:38:07.313191 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 364/751] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:06 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1679 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:08.301951 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a0a96046-8e46-4f2c-b976-d29fbab5e871 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:08.302580 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a0a96046-8e46-4f2c-b976-d29fbab5e871 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:08.316540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a0a96046-8e46-4f2c-b976-d29fbab5e871 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:08.317284 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a0a96046-8e46-4f2c-b976-d29fbab5e871 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:08.318247 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a0a96046-8e46-4f2c-b976-d29fbab5e871 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:08.318841 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a0a96046-8e46-4f2c-b976-d29fbab5e871 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:08.321409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e229de22-29f3-4301-9b63-f4cd7bccb3ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:08.322270 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e229de22-29f3-4301-9b63-f4cd7bccb3ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:08.338155 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e229de22-29f3-4301-9b63-f4cd7bccb3ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:08.338667 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e229de22-29f3-4301-9b63-f4cd7bccb3ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:08.347422 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e229de22-29f3-4301-9b63-f4cd7bccb3ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:08.347947 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e229de22-29f3-4301-9b63-f4cd7bccb3ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:08.453736 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a0a96046-8e46-4f2c-b976-d29fbab5e871 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:08.466827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a0a96046-8e46-4f2c-b976-d29fbab5e871 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1511 microversion: 2.1 time: 0.168566 May 12 14:38:08.479621 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 388/752] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:08 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:08.491424 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-c9e45c60-eaba-4731-ba8c-9bc359bc04bc req-735f75af-129c-45a7-a62a-973f79702219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a95d03a-223b-49bc-ba3a-afc4119c02c1", "name": "network-vif-deleted", "tag": "f024020e-bf8c-4cf9-8ca2-23128204e9b2"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:08.511129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-c9e45c60-eaba-4731-ba8c-9bc359bc04bc req-735f75af-129c-45a7-a62a-973f79702219 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:08.511920 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-c9e45c60-eaba-4731-ba8c-9bc359bc04bc req-735f75af-129c-45a7-a62a-973f79702219 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:08.544379 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-c9e45c60-eaba-4731-ba8c-9bc359bc04bc req-735f75af-129c-45a7-a62a-973f79702219 service nova] Creating event network-vif-deleted:f024020e-bf8c-4cf9-8ca2-23128204e9b2 for instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 on hv-cinder-77703 May 12 14:38:08.552533 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-c9e45c60-eaba-4731-ba8c-9bc359bc04bc req-735f75af-129c-45a7-a62a-973f79702219 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070622 May 12 14:38:08.553964 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 389/753] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:08.626469 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e229de22-29f3-4301-9b63-f4cd7bccb3ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:08.634481 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e229de22-29f3-4301-9b63-f4cd7bccb3ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 200 len: 1612 microversion: 2.1 time: 0.317994 May 12 14:38:08.647859 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 365/754] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:08 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 1612 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:09.486264 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-beca8f51-46c1-4c84-a543-4ef011e9d9db tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:09.487171 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-beca8f51-46c1-4c84-a543-4ef011e9d9db tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:09.502034 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-beca8f51-46c1-4c84-a543-4ef011e9d9db tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:09.505379 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-beca8f51-46c1-4c84-a543-4ef011e9d9db tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:09.506328 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-beca8f51-46c1-4c84-a543-4ef011e9d9db tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:09.507515 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-beca8f51-46c1-4c84-a543-4ef011e9d9db tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:09.652103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ec33d4d1-7a55-4285-ac38-a20f6657cf70 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:09.653590 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ec33d4d1-7a55-4285-ac38-a20f6657cf70 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:09.666339 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec33d4d1-7a55-4285-ac38-a20f6657cf70 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:09.667566 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec33d4d1-7a55-4285-ac38-a20f6657cf70 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:09.671901 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec33d4d1-7a55-4285-ac38-a20f6657cf70 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:09.672544 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ec33d4d1-7a55-4285-ac38-a20f6657cf70 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:09.676236 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-beca8f51-46c1-4c84-a543-4ef011e9d9db tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:09.688994 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-beca8f51-46c1-4c84-a543-4ef011e9d9db tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 200 len: 1225 microversion: 2.1 time: 0.207054 May 12 14:38:09.690725 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 390/755] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:09 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 1225 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:09.706140 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-ec33d4d1-7a55-4285-ac38-a20f6657cf70 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] HTTP exception thrown: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ec33d4d1-7a55-4285-ac38-a20f6657cf70 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Request method failure captured: May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 HTTP/1.1 May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRo-ycWfHqPPxbmLiuTXrtXJLZwYU78oTuGhPDkiQSHU7CKcy_GQqpZ_HWFwpOkfP_a2cy2OZwfawJtQIkHx1tZyLxJZoQOwjSpujcF6pQ0BcV3O7kKLbSCm6-7BGei9mU5XP-t1FCFU5rK_O_aRKcjHsdbD5yR-8mP9_YNetCjLQkw May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:38:09.713591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:38:09.715312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4b5ca018b5f4dda99486407424b8168", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:38:09.715312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-AttachVolumeNegativeTest-523912070 May 12 14:38:09.715312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:38:09.715312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:38:09.715312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:38:09.715312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:38:09.715312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:38:09.715312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: c6422873a3b84aac88f8a93291bcd7b0 May 12 14:38:09.715312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:38:09.715312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:38:09.715312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. May 12 14:38:09.715312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '6a95d03a-223b-49bc-ba3a-afc4119c02c1'} May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:38:09.716079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. May 12 14:38:09.717356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:38:09.719980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ec33d4d1-7a55-4285-ac38-a20f6657cf70 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Returning 404 to user: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:38:09.721138 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ec33d4d1-7a55-4285-ac38-a20f6657cf70 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 404 len: 111 microversion: 2.1 time: 0.072924 May 12 14:38:09.730883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-dd48f082-6165-4c34-b1b0-25c3047bad91 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '.version_select at 0x7f5b268d7d30>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:09.731556 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 366/756] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:09 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:38:09.785735 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-dd48f082-6165-4c34-b1b0-25c3047bad91 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-173808100" status: 202 len: 0 microversion: 2.1 time: 0.059070 May 12 14:38:09.786407 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 391/757] 10.222.0.75 () {58 vars in 1217 bytes} [Thu May 12 14:38:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-173808100 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:38:10.251539 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1302c5e5-3dae-45bf-8cb4-71d4000ee693 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Action: 'create', calling method: .version_select at 0x7f5b261c3e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-352854606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGu/f2a9p4ru434Oum6Y1ohT6lBiPLqpzleMQs/HLEMzRYgeYs6NTaZqsobXHbraVCD814HGQPFozby4B3OkNDIKNlk6l/TVTkIbuT3ynJ3qAe/khF6+6nvVc+h+a/HOXA=="}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:10.277369 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-1302c5e5-3dae-45bf-8cb4-71d4000ee693 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Getting quotas for project 9462307fa603476baafa1c5c8ae491d5. Resources: {'key_pairs'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:38:10.283077 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-1302c5e5-3dae-45bf-8cb4-71d4000ee693 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Getting quotas for user e3a87d665be74a73ae84e15c39b735ad and project 9462307fa603476baafa1c5c8ae491d5. Resources: {'key_pairs'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:38:10.317099 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1302c5e5-3dae-45bf-8cb4-71d4000ee693 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.070812 May 12 14:38:10.317709 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 367/758] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 12 14:38:10 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:10.389742 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1190500120", "imageRef": "5b6e8c35-beb7-46ca-a658-1cd65d24b40d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-352854606", "networks": [{"uuid": "02beb22d-1f56-4737-bf39-f35baef398aa"}]}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:10.448450 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.network.neutron [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] validate_networks() for [('02beb22d-1f56-4737-bf39-f35baef398aa', None, None, None, None, None)] {{(pid=118217) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:38:10.572383 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-211fb8eb-90f3-475d-9c56-da55a809c5c3 req-b3656b37-5ca2-4639-b500-e39e3a4f6d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53d1801-00ff-4886-8632-1d02c3275dd5", "name": "network-vif-deleted", "tag": "e20769a6-986c-4bef-a558-db20551da4d2"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:10.586701 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-211fb8eb-90f3-475d-9c56-da55a809c5c3 req-b3656b37-5ca2-4639-b500-e39e3a4f6d45 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:10.587522 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-211fb8eb-90f3-475d-9c56-da55a809c5c3 req-b3656b37-5ca2-4639-b500-e39e3a4f6d45 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:10.602196 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-211fb8eb-90f3-475d-9c56-da55a809c5c3 req-b3656b37-5ca2-4639-b500-e39e3a4f6d45 service nova] Creating event network-vif-deleted:e20769a6-986c-4bef-a558-db20551da4d2 for instance b53d1801-00ff-4886-8632-1d02c3275dd5 on hv-cinder-77703 May 12 14:38:10.607959 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-211fb8eb-90f3-475d-9c56-da55a809c5c3 req-b3656b37-5ca2-4639-b500-e39e3a4f6d45 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040463 May 12 14:38:10.610100 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 368/759] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:38:10.706769 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1fb11031-3df4-460a-9bcf-57583eaf7f7d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:10.708337 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1fb11031-3df4-460a-9bcf-57583eaf7f7d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:10.715208 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1fb11031-3df4-460a-9bcf-57583eaf7f7d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:10.716033 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1fb11031-3df4-460a-9bcf-57583eaf7f7d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:10.717045 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1fb11031-3df4-460a-9bcf-57583eaf7f7d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:10.717700 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1fb11031-3df4-460a-9bcf-57583eaf7f7d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:10.733380 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-1fb11031-3df4-460a-9bcf-57583eaf7f7d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] HTTP exception thrown: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1fb11031-3df4-460a-9bcf-57583eaf7f7d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Request method failure captured: May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 HTTP/1.1 May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRqiHHLmmOHPj4maZnGsOi2nwns-851SXrvWGLlrvUXxrxFY3BZTuRQU_iFr0NA3QudzbzJC9YcjG6RkGlYiv9WUFskhxIEwaJNhweIFCcbkNOwgTopg3_BGXsuQbb5YkZd2MudSuKBy6CZqIwlUN6wzq_LSJcm6TpNFM-o0bCTHj7I May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 0ba0ea753bb0496cbf274e802f50dd0e May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-TestVolumeBootPattern-6195434 May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:38:10.736142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:38:10.738190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0ba0ea753bb0496cbf274e802f50dd0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0ba0ea753bb0496cbf274e802f50dd0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0ba0ea753bb0496cbf274e802f50dd0e", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0ba0ea753bb0496cbf274e802f50dd0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:38:10.738190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-TestVolumeBootPattern-6195434 May 12 14:38:10.738190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 0ba0ea753bb0496cbf274e802f50dd0e May 12 14:38:10.738190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-TestVolumeBootPattern-6195434 May 12 14:38:10.738190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-TestVolumeBootPattern-6195434-project May 12 14:38:10.738190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:38:10.738190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:38:10.738190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: a64c3ea69151401897e4203095676543 May 12 14:38:10.738190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-TestVolumeBootPattern-6195434-project May 12 14:38:10.738190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:38:10.738190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. May 12 14:38:10.738190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': 'b53d1801-00ff-4886-8632-1d02c3275dd5'} May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:38:10.739021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. May 12 14:38:10.740209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:38:10.741611 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1fb11031-3df4-460a-9bcf-57583eaf7f7d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Returning 404 to user: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:38:10.745494 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1fb11031-3df4-460a-9bcf-57583eaf7f7d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 404 len: 111 microversion: 2.1 time: 0.043224 May 12 14:38:10.746298 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 369/760] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:10 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:38:10.913361 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-764167040", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-349363195", "security_groups": [{"name": "tempest-secgroup-smoke-2090511352"}], "block_device_mapping_v2": [{"uuid": "2e0e2235-be71-482f-a048-e519de8c66ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5b96f110-6030-45d9-96d1-0bc86d38fd01"}]}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:11.129905 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.network.neutron [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] validate_networks() for [('5b96f110-6030-45d9-96d1-0bc86d38fd01', None, None, None, None, None)] {{(pid=118216) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:38:11.475098 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Flavor limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:38:11.475588 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Image limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:38:11.476007 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Flavor pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:38:11.476424 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Image pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:38:11.476846 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:38:11.486015 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.486476 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.487325 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.487770 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.505743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Getting quotas for project 9462307fa603476baafa1c5c8ae491d5. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:38:11.509740 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Getting quotas for user e3a87d665be74a73ae84e15c39b735ad and project 9462307fa603476baafa1c5c8ae491d5. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:38:11.522433 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Going to run 1 instances... {{(pid=118217) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:38:11.525003 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b6e8c35-beb7-46ca-a658-1cd65d24b40d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:38:11.574207 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8f53f7aa-0fbc-4af1-b3ad-440f83d26de0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.190104 May 12 14:38:11.575202 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 392/761] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:38:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:38:11.585441 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3bc1eb8b-b220-4ba7-b4da-217fcc9b131e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:11.585954 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3bc1eb8b-b220-4ba7-b4da-217fcc9b131e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:11.592176 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3bc1eb8b-b220-4ba7-b4da-217fcc9b131e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.592836 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3bc1eb8b-b220-4ba7-b4da-217fcc9b131e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.594348 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3bc1eb8b-b220-4ba7-b4da-217fcc9b131e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.594957 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3bc1eb8b-b220-4ba7-b4da-217fcc9b131e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.705614 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-3bc1eb8b-b220-4ba7-b4da-217fcc9b131e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lazy-loading 'services' on Instance uuid 1fab0a31-9c59-40c0-8350-788bf0458078 {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:38:11.745542 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Flavor limits 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:38:11.746863 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Image limits 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:38:11.747553 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Flavor pref 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:38:11.748019 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Image pref 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:38:11.748377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:38:11.760310 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.760777 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.761917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.762384 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.780553 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Getting quotas for project 0ba0ea753bb0496cbf274e802f50dd0e. Resources: {'cores', 'instances', 'ram'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:38:11.783656 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3bc1eb8b-b220-4ba7-b4da-217fcc9b131e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078/os-volume_attachments/97e190c3-d77e-4998-b3c6-42aad50a898c" status: 202 len: 0 microversion: 2.1 time: 0.206959 May 12 14:38:11.784330 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 393/762] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 12 14:38:11 2022] DELETE /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078/os-volume_attachments/97e190c3-d77e-4998-b3c6-42aad50a898c => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:38:11.789137 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Getting quotas for user a64c3ea69151401897e4203095676543 and project 0ba0ea753bb0496cbf274e802f50dd0e. Resources: {'cores', 'instances', 'ram'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:38:11.790493 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f7630e98-01de-49a6-a8fd-b69486322dca tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:11.797347 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f7630e98-01de-49a6-a8fd-b69486322dca tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:11.861814 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f7630e98-01de-49a6-a8fd-b69486322dca tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:11.867511 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Going to run 1 instances... {{(pid=118216) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:38:11.869733 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e0e2235-be71-482f-a048-e519de8c66ff',volume_size=None,volume_type=None)] {{(pid=118216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:38:11.879710 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f7630e98-01de-49a6-a8fd-b69486322dca tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1258 microversion: 2.1 time: 0.093934 May 12 14:38:11.883108 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 394/763] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:11 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1258 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:11.888142 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e759ee5e-1b37-4456-86e0-43d045254d7f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:11.889133 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e759ee5e-1b37-4456-86e0-43d045254d7f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:11.901228 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e759ee5e-1b37-4456-86e0-43d045254d7f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.901879 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e759ee5e-1b37-4456-86e0-43d045254d7f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.902989 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e759ee5e-1b37-4456-86e0-43d045254d7f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:11.903662 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e759ee5e-1b37-4456-86e0-43d045254d7f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:11.942713 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e759ee5e-1b37-4456-86e0-43d045254d7f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058100 May 12 14:38:11.947900 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 395/764] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:38:11 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:12.045576 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6ec79eed-e93f-4455-902d-86d36bce745d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.135075 May 12 14:38:12.047703 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 370/765] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:38:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:38:12.063463 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b849bb9b-deca-438f-a07b-0cb5846128c9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:12.068244 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b849bb9b-deca-438f-a07b-0cb5846128c9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:12.148837 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b849bb9b-deca-438f-a07b-0cb5846128c9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:12.155565 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b849bb9b-deca-438f-a07b-0cb5846128c9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1093 microversion: 2.1 time: 0.101552 May 12 14:38:12.156195 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 396/766] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:12 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1093 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:12.898034 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-653f04c8-e7a2-409d-8650-7cd7fa92943d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:12.898654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-653f04c8-e7a2-409d-8650-7cd7fa92943d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:12.904683 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-653f04c8-e7a2-409d-8650-7cd7fa92943d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:12.905135 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-653f04c8-e7a2-409d-8650-7cd7fa92943d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:12.906561 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-653f04c8-e7a2-409d-8650-7cd7fa92943d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:12.907000 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-653f04c8-e7a2-409d-8650-7cd7fa92943d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:12.956103 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-169b2d29-2103-40c7-9b77-6c02d6731efc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:12.957032 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-169b2d29-2103-40c7-9b77-6c02d6731efc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:12.964815 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-169b2d29-2103-40c7-9b77-6c02d6731efc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:12.965437 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-169b2d29-2103-40c7-9b77-6c02d6731efc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:12.966939 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-653f04c8-e7a2-409d-8650-7cd7fa92943d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:12.975691 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-653f04c8-e7a2-409d-8650-7cd7fa92943d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1310 microversion: 2.1 time: 0.081898 May 12 14:38:12.976361 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 371/767] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:12 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:12.978415 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-169b2d29-2103-40c7-9b77-6c02d6731efc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:12.978894 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-169b2d29-2103-40c7-9b77-6c02d6731efc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:13.013045 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-169b2d29-2103-40c7-9b77-6c02d6731efc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061220 May 12 14:38:13.013819 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 397/768] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:38:12 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:38:13.172770 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7701dd6b-c6dc-497f-b773-fc4c3c8da5df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:13.173305 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7701dd6b-c6dc-497f-b773-fc4c3c8da5df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:13.179475 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7701dd6b-c6dc-497f-b773-fc4c3c8da5df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:13.179941 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7701dd6b-c6dc-497f-b773-fc4c3c8da5df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:13.180730 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7701dd6b-c6dc-497f-b773-fc4c3c8da5df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:13.181177 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7701dd6b-c6dc-497f-b773-fc4c3c8da5df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:13.240562 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7701dd6b-c6dc-497f-b773-fc4c3c8da5df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:13.248026 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7701dd6b-c6dc-497f-b773-fc4c3c8da5df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1191 microversion: 2.1 time: 0.079274 May 12 14:38:13.249013 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 372/769] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:13 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1191 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:13.993556 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3aa1c6ac-b729-41eb-b524-365968e4f392 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:13.994203 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3aa1c6ac-b729-41eb-b524-365968e4f392 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:14.010791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3aa1c6ac-b729-41eb-b524-365968e4f392 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.011282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3aa1c6ac-b729-41eb-b524-365968e4f392 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.012097 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3aa1c6ac-b729-41eb-b524-365968e4f392 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.012533 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3aa1c6ac-b729-41eb-b524-365968e4f392 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.028435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7f4e6f19-8957-4455-80aa-f72d54b744e9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:14.029434 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7f4e6f19-8957-4455-80aa-f72d54b744e9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:14.041642 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7f4e6f19-8957-4455-80aa-f72d54b744e9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.042096 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7f4e6f19-8957-4455-80aa-f72d54b744e9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.042882 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7f4e6f19-8957-4455-80aa-f72d54b744e9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.051990 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7f4e6f19-8957-4455-80aa-f72d54b744e9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.102054 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7f4e6f19-8957-4455-80aa-f72d54b744e9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079194 May 12 14:38:14.103602 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 373/770] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:38:14 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:38:14.186480 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3aa1c6ac-b729-41eb-b524-365968e4f392 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:14.195944 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3aa1c6ac-b729-41eb-b524-365968e4f392 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1316 microversion: 2.1 time: 0.206294 May 12 14:38:14.209124 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a5c78edb-4dfc-43c0-a4c8-9b2d3cd5c071 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:14.210885 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a5c78edb-4dfc-43c0-a4c8-9b2d3cd5c071 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:14.211402 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 398/771] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:13 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:14.218928 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a5c78edb-4dfc-43c0-a4c8-9b2d3cd5c071 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.220402 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a5c78edb-4dfc-43c0-a4c8-9b2d3cd5c071 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.221938 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a5c78edb-4dfc-43c0-a4c8-9b2d3cd5c071 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.222633 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a5c78edb-4dfc-43c0-a4c8-9b2d3cd5c071 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.266318 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f65e3544-787a-41bf-abed-ddada31ad222 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:14.266924 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f65e3544-787a-41bf-abed-ddada31ad222 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:14.275276 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a5c78edb-4dfc-43c0-a4c8-9b2d3cd5c071 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Going to try to terminate instance {{(pid=118216) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:38:14.282504 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f65e3544-787a-41bf-abed-ddada31ad222 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.283145 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f65e3544-787a-41bf-abed-ddada31ad222 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.283966 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f65e3544-787a-41bf-abed-ddada31ad222 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.284620 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f65e3544-787a-41bf-abed-ddada31ad222 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.414445 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a5c78edb-4dfc-43c0-a4c8-9b2d3cd5c071 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 204 len: 0 microversion: 2.1 time: 0.209576 May 12 14:38:14.418591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 374/772] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:38:14 2022] DELETE /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:38:14.424941 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f2b2807b-75d7-495d-bc0a-4d3a02b639a5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:14.428279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f2b2807b-75d7-495d-bc0a-4d3a02b639a5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:14.438944 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f2b2807b-75d7-495d-bc0a-4d3a02b639a5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.439729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f2b2807b-75d7-495d-bc0a-4d3a02b639a5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.440534 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f2b2807b-75d7-495d-bc0a-4d3a02b639a5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:14.440964 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f65e3544-787a-41bf-abed-ddada31ad222 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:14.441093 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f2b2807b-75d7-495d-bc0a-4d3a02b639a5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:14.448371 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f65e3544-787a-41bf-abed-ddada31ad222 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1209 microversion: 2.1 time: 0.186393 May 12 14:38:14.454867 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 399/773] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:14 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1209 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:14.873063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f2b2807b-75d7-495d-bc0a-4d3a02b639a5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:14.881135 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f2b2807b-75d7-495d-bc0a-4d3a02b639a5 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1682 microversion: 2.1 time: 0.461055 May 12 14:38:14.881645 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 375/774] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:14 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1682 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:15.218207 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-051ab48c-f9c1-43f5-ab06-06bb13e32589 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:15.219380 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-051ab48c-f9c1-43f5-ab06-06bb13e32589 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:15.225805 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-051ab48c-f9c1-43f5-ab06-06bb13e32589 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:15.226260 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-051ab48c-f9c1-43f5-ab06-06bb13e32589 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:15.227250 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-051ab48c-f9c1-43f5-ab06-06bb13e32589 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:15.227855 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-051ab48c-f9c1-43f5-ab06-06bb13e32589 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:15.376894 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-051ab48c-f9c1-43f5-ab06-06bb13e32589 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:15.385070 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-051ab48c-f9c1-43f5-ab06-06bb13e32589 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.170692 May 12 14:38:15.385750 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 400/775] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:15 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:15.471430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-735d7468-34d2-4761-b047-8c6b5b5ab10d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:15.472044 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-735d7468-34d2-4761-b047-8c6b5b5ab10d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:15.478401 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-735d7468-34d2-4761-b047-8c6b5b5ab10d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:15.478848 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-735d7468-34d2-4761-b047-8c6b5b5ab10d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:15.479642 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-735d7468-34d2-4761-b047-8c6b5b5ab10d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:15.480082 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-735d7468-34d2-4761-b047-8c6b5b5ab10d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:15.616602 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-735d7468-34d2-4761-b047-8c6b5b5ab10d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:15.625175 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-735d7468-34d2-4761-b047-8c6b5b5ab10d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1277 microversion: 2.1 time: 0.157251 May 12 14:38:15.625770 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 376/776] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:15 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:15.898666 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-6d336821-7273-4a8c-8916-f5a6a50b801a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:15.899339 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-6d336821-7273-4a8c-8916-f5a6a50b801a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:15.905437 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6d336821-7273-4a8c-8916-f5a6a50b801a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:15.905901 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6d336821-7273-4a8c-8916-f5a6a50b801a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:15.906679 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6d336821-7273-4a8c-8916-f5a6a50b801a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:15.907183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6d336821-7273-4a8c-8916-f5a6a50b801a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.058933 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-6d336821-7273-4a8c-8916-f5a6a50b801a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:16.067075 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-6d336821-7273-4a8c-8916-f5a6a50b801a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1682 microversion: 2.1 time: 0.172258 May 12 14:38:16.067660 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 401/777] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:15 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:16.401790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-dac67724-50da-43da-a755-46f21d39ac79 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:16.402402 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-dac67724-50da-43da-a755-46f21d39ac79 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:16.408928 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dac67724-50da-43da-a755-46f21d39ac79 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.409409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dac67724-50da-43da-a755-46f21d39ac79 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.410177 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dac67724-50da-43da-a755-46f21d39ac79 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.410616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dac67724-50da-43da-a755-46f21d39ac79 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.559524 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-dac67724-50da-43da-a755-46f21d39ac79 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:16.567060 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-dac67724-50da-43da-a755-46f21d39ac79 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.169074 May 12 14:38:16.567657 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 377/778] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:16 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:16.698693 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-11ec2322-fddd-4831-a44c-5d0354c3961f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:16.700576 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-11ec2322-fddd-4831-a44c-5d0354c3961f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:16.710194 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-11ec2322-fddd-4831-a44c-5d0354c3961f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.711725 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-11ec2322-fddd-4831-a44c-5d0354c3961f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.712776 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-11ec2322-fddd-4831-a44c-5d0354c3961f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:16.713504 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-11ec2322-fddd-4831-a44c-5d0354c3961f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:16.855367 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-11ec2322-fddd-4831-a44c-5d0354c3961f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:16.866879 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-11ec2322-fddd-4831-a44c-5d0354c3961f tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1277 microversion: 2.1 time: 0.228694 May 12 14:38:16.867496 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 402/779] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:16 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1277 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:17.084174 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-de2951e8-282e-494e-9c04-d5e3626c9731 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:17.084797 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-de2951e8-282e-494e-9c04-d5e3626c9731 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:17.090811 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-de2951e8-282e-494e-9c04-d5e3626c9731 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.091308 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-de2951e8-282e-494e-9c04-d5e3626c9731 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.092089 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-de2951e8-282e-494e-9c04-d5e3626c9731 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.092535 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-de2951e8-282e-494e-9c04-d5e3626c9731 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.230857 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-de2951e8-282e-494e-9c04-d5e3626c9731 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:17.239424 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-de2951e8-282e-494e-9c04-d5e3626c9731 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1682 microversion: 2.1 time: 0.159148 May 12 14:38:17.240212 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 378/780] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:17 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:17.583767 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0268d9b4-c088-4778-928b-a1eddf683817 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:17.584390 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0268d9b4-c088-4778-928b-a1eddf683817 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:17.590357 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0268d9b4-c088-4778-928b-a1eddf683817 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.590816 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0268d9b4-c088-4778-928b-a1eddf683817 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.591632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0268d9b4-c088-4778-928b-a1eddf683817 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.592079 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0268d9b4-c088-4778-928b-a1eddf683817 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.730377 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0268d9b4-c088-4778-928b-a1eddf683817 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:17.738657 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0268d9b4-c088-4778-928b-a1eddf683817 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.158612 May 12 14:38:17.748748 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 403/781] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:17 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:17.884639 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-69f6afad-cf98-43f9-a3f5-7fbee4a8db93 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:17.885963 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-69f6afad-cf98-43f9-a3f5-7fbee4a8db93 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:17.894334 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-69f6afad-cf98-43f9-a3f5-7fbee4a8db93 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.894790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-69f6afad-cf98-43f9-a3f5-7fbee4a8db93 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:17.895602 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-69f6afad-cf98-43f9-a3f5-7fbee4a8db93 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:17.896070 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-69f6afad-cf98-43f9-a3f5-7fbee4a8db93 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:18.043772 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-69f6afad-cf98-43f9-a3f5-7fbee4a8db93 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:18.051473 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-69f6afad-cf98-43f9-a3f5-7fbee4a8db93 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1277 microversion: 2.1 time: 0.170716 May 12 14:38:18.052043 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 379/782] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:17 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:18.256561 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e01816cf-bbbe-43b0-baee-2abb439494e4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:18.257084 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e01816cf-bbbe-43b0-baee-2abb439494e4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:18.263238 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e01816cf-bbbe-43b0-baee-2abb439494e4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:18.263696 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e01816cf-bbbe-43b0-baee-2abb439494e4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:18.264481 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e01816cf-bbbe-43b0-baee-2abb439494e4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:18.264984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e01816cf-bbbe-43b0-baee-2abb439494e4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:18.395085 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e01816cf-bbbe-43b0-baee-2abb439494e4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:18.402908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e01816cf-bbbe-43b0-baee-2abb439494e4 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1682 microversion: 2.1 time: 0.150202 May 12 14:38:18.403545 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 404/783] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:18 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:18.756411 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a9d8c9d2-9fae-4186-8edb-34f14e7a4595 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:18.757031 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a9d8c9d2-9fae-4186-8edb-34f14e7a4595 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:18.763087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9d8c9d2-9fae-4186-8edb-34f14e7a4595 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:18.763552 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9d8c9d2-9fae-4186-8edb-34f14e7a4595 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:18.764335 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9d8c9d2-9fae-4186-8edb-34f14e7a4595 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:18.765048 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9d8c9d2-9fae-4186-8edb-34f14e7a4595 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:18.904931 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a9d8c9d2-9fae-4186-8edb-34f14e7a4595 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:18.913325 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a9d8c9d2-9fae-4186-8edb-34f14e7a4595 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.161174 May 12 14:38:18.914136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 380/784] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:18 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:19.068226 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3463ece5-6f57-4309-a67a-2806540039ba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:19.068927 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3463ece5-6f57-4309-a67a-2806540039ba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:19.076353 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3463ece5-6f57-4309-a67a-2806540039ba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.076813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3463ece5-6f57-4309-a67a-2806540039ba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.078545 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3463ece5-6f57-4309-a67a-2806540039ba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.078997 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3463ece5-6f57-4309-a67a-2806540039ba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.213670 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3463ece5-6f57-4309-a67a-2806540039ba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:19.225445 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3463ece5-6f57-4309-a67a-2806540039ba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1277 microversion: 2.1 time: 0.160993 May 12 14:38:19.226502 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 405/785] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:19 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:19.420248 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-fdcfeab4-e141-48d1-9b69-4b35361b17f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:19.420785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-fdcfeab4-e141-48d1-9b69-4b35361b17f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:19.430553 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fdcfeab4-e141-48d1-9b69-4b35361b17f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.431600 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fdcfeab4-e141-48d1-9b69-4b35361b17f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.433048 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fdcfeab4-e141-48d1-9b69-4b35361b17f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.434249 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fdcfeab4-e141-48d1-9b69-4b35361b17f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.566142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-fdcfeab4-e141-48d1-9b69-4b35361b17f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:19.573409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-fdcfeab4-e141-48d1-9b69-4b35361b17f9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1682 microversion: 2.1 time: 0.157078 May 12 14:38:19.573979 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 381/786] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:19 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:19.929764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e9a4dab8-f736-4414-ab45-1078e3394889 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:19.930400 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e9a4dab8-f736-4414-ab45-1078e3394889 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:19.937961 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e9a4dab8-f736-4414-ab45-1078e3394889 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.938516 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e9a4dab8-f736-4414-ab45-1078e3394889 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:19.939451 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e9a4dab8-f736-4414-ab45-1078e3394889 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:19.939973 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e9a4dab8-f736-4414-ab45-1078e3394889 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:20.085726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e9a4dab8-f736-4414-ab45-1078e3394889 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:20.093350 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e9a4dab8-f736-4414-ab45-1078e3394889 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.167395 May 12 14:38:20.094312 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 406/787] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:19 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:20.241783 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-91ede3a7-267e-4fab-88a1-b14661328f6b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:20.242368 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-91ede3a7-267e-4fab-88a1-b14661328f6b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:20.250109 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-91ede3a7-267e-4fab-88a1-b14661328f6b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:20.250552 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-91ede3a7-267e-4fab-88a1-b14661328f6b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:20.251346 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-91ede3a7-267e-4fab-88a1-b14661328f6b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:20.251778 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-91ede3a7-267e-4fab-88a1-b14661328f6b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:20.398513 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-91ede3a7-267e-4fab-88a1-b14661328f6b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:20.406422 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-91ede3a7-267e-4fab-88a1-b14661328f6b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1277 microversion: 2.1 time: 0.168480 May 12 14:38:20.416051 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 382/788] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:20 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:20.591548 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f559bee1-b4e3-4391-bd74-5e577d92fed3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:20.592172 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f559bee1-b4e3-4391-bd74-5e577d92fed3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:20.598108 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f559bee1-b4e3-4391-bd74-5e577d92fed3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:20.598570 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f559bee1-b4e3-4391-bd74-5e577d92fed3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:20.599388 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f559bee1-b4e3-4391-bd74-5e577d92fed3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:20.599835 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f559bee1-b4e3-4391-bd74-5e577d92fed3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:20.734370 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f559bee1-b4e3-4391-bd74-5e577d92fed3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:20.742711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f559bee1-b4e3-4391-bd74-5e577d92fed3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1682 microversion: 2.1 time: 0.154873 May 12 14:38:20.746539 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 407/789] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:20 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:21.110098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-90d86918-8e70-4a61-a822-1dcfbf7be93d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:21.110750 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-90d86918-8e70-4a61-a822-1dcfbf7be93d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:21.116755 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-90d86918-8e70-4a61-a822-1dcfbf7be93d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.117206 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-90d86918-8e70-4a61-a822-1dcfbf7be93d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.117980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-90d86918-8e70-4a61-a822-1dcfbf7be93d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.118421 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-90d86918-8e70-4a61-a822-1dcfbf7be93d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.245395 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-90d86918-8e70-4a61-a822-1dcfbf7be93d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:21.253651 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-90d86918-8e70-4a61-a822-1dcfbf7be93d tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.147464 May 12 14:38:21.254621 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 383/790] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:21 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:21.423450 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c51b49b0-59fb-4d4b-a908-3051a1a2de21 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:21.424065 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c51b49b0-59fb-4d4b-a908-3051a1a2de21 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:21.430250 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c51b49b0-59fb-4d4b-a908-3051a1a2de21 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.430699 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c51b49b0-59fb-4d4b-a908-3051a1a2de21 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.431500 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c51b49b0-59fb-4d4b-a908-3051a1a2de21 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.431954 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c51b49b0-59fb-4d4b-a908-3051a1a2de21 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.570847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c51b49b0-59fb-4d4b-a908-3051a1a2de21 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:21.579091 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c51b49b0-59fb-4d4b-a908-3051a1a2de21 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1277 microversion: 2.1 time: 0.159520 May 12 14:38:21.579793 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 408/791] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:21 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:21.759790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4275b868-0129-465e-abc2-b09e1f6769ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:21.760540 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4275b868-0129-465e-abc2-b09e1f6769ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:21.767213 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4275b868-0129-465e-abc2-b09e1f6769ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.767622 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4275b868-0129-465e-abc2-b09e1f6769ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.768394 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4275b868-0129-465e-abc2-b09e1f6769ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:21.768835 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4275b868-0129-465e-abc2-b09e1f6769ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:21.893502 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4275b868-0129-465e-abc2-b09e1f6769ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:21.901027 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4275b868-0129-465e-abc2-b09e1f6769ec tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1682 microversion: 2.1 time: 0.145180 May 12 14:38:21.901600 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 384/792] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:21 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1682 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:22.272171 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-936e4e1b-6d37-4869-8205-fdb99d4dbd50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:22.272793 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-936e4e1b-6d37-4869-8205-fdb99d4dbd50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:22.278712 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-936e4e1b-6d37-4869-8205-fdb99d4dbd50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:22.279209 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-936e4e1b-6d37-4869-8205-fdb99d4dbd50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:22.279991 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-936e4e1b-6d37-4869-8205-fdb99d4dbd50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:22.280946 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-936e4e1b-6d37-4869-8205-fdb99d4dbd50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:22.448350 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-936e4e1b-6d37-4869-8205-fdb99d4dbd50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:22.455654 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-936e4e1b-6d37-4869-8205-fdb99d4dbd50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.187362 May 12 14:38:22.456220 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 409/793] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:22 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:22.596019 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0e91ebfa-6c66-448d-97e8-d4617341d566 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:22.596653 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0e91ebfa-6c66-448d-97e8-d4617341d566 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:22.602909 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0e91ebfa-6c66-448d-97e8-d4617341d566 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:22.603389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0e91ebfa-6c66-448d-97e8-d4617341d566 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:22.604173 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0e91ebfa-6c66-448d-97e8-d4617341d566 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:22.604608 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0e91ebfa-6c66-448d-97e8-d4617341d566 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:22.730961 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0e91ebfa-6c66-448d-97e8-d4617341d566 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:22.738229 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0e91ebfa-6c66-448d-97e8-d4617341d566 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1277 microversion: 2.1 time: 0.146666 May 12 14:38:22.738801 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 385/794] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:22 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:22.918185 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-12c1de30-dd9d-4c47-aee7-dac06cd0cdc3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:22.918716 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-12c1de30-dd9d-4c47-aee7-dac06cd0cdc3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:22.924676 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-12c1de30-dd9d-4c47-aee7-dac06cd0cdc3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:22.925125 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-12c1de30-dd9d-4c47-aee7-dac06cd0cdc3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:22.925891 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-12c1de30-dd9d-4c47-aee7-dac06cd0cdc3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:22.926327 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-12c1de30-dd9d-4c47-aee7-dac06cd0cdc3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:23.053217 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-12c1de30-dd9d-4c47-aee7-dac06cd0cdc3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:23.060500 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-12c1de30-dd9d-4c47-aee7-dac06cd0cdc3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1682 microversion: 2.1 time: 0.146323 May 12 14:38:23.061084 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 410/795] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:22 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:23.472910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ff48d543-e5e5-4238-8a1d-7666b39fc8dc tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:23.473536 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ff48d543-e5e5-4238-8a1d-7666b39fc8dc tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:23.479447 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff48d543-e5e5-4238-8a1d-7666b39fc8dc tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:23.479899 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff48d543-e5e5-4238-8a1d-7666b39fc8dc tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:23.480680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff48d543-e5e5-4238-8a1d-7666b39fc8dc tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:23.481114 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff48d543-e5e5-4238-8a1d-7666b39fc8dc tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:23.605122 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ff48d543-e5e5-4238-8a1d-7666b39fc8dc tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:23.613244 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ff48d543-e5e5-4238-8a1d-7666b39fc8dc tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.144281 May 12 14:38:23.614718 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 386/796] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:23 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:23.755163 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-140f4488-b98a-460a-aff5-27edafbf92b5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:23.755869 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-140f4488-b98a-460a-aff5-27edafbf92b5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:23.762233 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-140f4488-b98a-460a-aff5-27edafbf92b5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:23.762688 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-140f4488-b98a-460a-aff5-27edafbf92b5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:23.763489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-140f4488-b98a-460a-aff5-27edafbf92b5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:23.763924 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-140f4488-b98a-460a-aff5-27edafbf92b5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:23.917465 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-140f4488-b98a-460a-aff5-27edafbf92b5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:23.926145 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-140f4488-b98a-460a-aff5-27edafbf92b5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1277 microversion: 2.1 time: 0.174956 May 12 14:38:23.927076 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 411/797] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:23 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:24.078947 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4d210e95-0458-44d6-93ef-fffeaae9fac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:24.079606 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4d210e95-0458-44d6-93ef-fffeaae9fac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:24.085865 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4d210e95-0458-44d6-93ef-fffeaae9fac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.086731 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4d210e95-0458-44d6-93ef-fffeaae9fac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:24.087621 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4d210e95-0458-44d6-93ef-fffeaae9fac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.088131 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4d210e95-0458-44d6-93ef-fffeaae9fac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:24.220701 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4d210e95-0458-44d6-93ef-fffeaae9fac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:24.228865 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4d210e95-0458-44d6-93ef-fffeaae9fac6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1682 microversion: 2.1 time: 0.154102 May 12 14:38:24.229426 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 387/798] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:24 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:24.631588 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-63616307-78ce-434f-be92-5fc0ab1fd026 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:24.632228 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-63616307-78ce-434f-be92-5fc0ab1fd026 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:24.638261 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-63616307-78ce-434f-be92-5fc0ab1fd026 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.638719 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-63616307-78ce-434f-be92-5fc0ab1fd026 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:24.639559 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-63616307-78ce-434f-be92-5fc0ab1fd026 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.640526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-63616307-78ce-434f-be92-5fc0ab1fd026 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:24.810256 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-63616307-78ce-434f-be92-5fc0ab1fd026 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:24.819652 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-63616307-78ce-434f-be92-5fc0ab1fd026 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.191715 May 12 14:38:24.820878 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 412/799] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:24 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:24.944028 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a61c25e4-78b3-4bcb-907a-a27338f45797 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:24.944645 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a61c25e4-78b3-4bcb-907a-a27338f45797 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:24.951532 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a61c25e4-78b3-4bcb-907a-a27338f45797 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.952342 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a61c25e4-78b3-4bcb-907a-a27338f45797 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:24.953369 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a61c25e4-78b3-4bcb-907a-a27338f45797 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:24.954022 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a61c25e4-78b3-4bcb-907a-a27338f45797 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:25.097310 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a61c25e4-78b3-4bcb-907a-a27338f45797 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:25.104373 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a61c25e4-78b3-4bcb-907a-a27338f45797 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1277 microversion: 2.1 time: 0.164698 May 12 14:38:25.104932 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 388/800] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:24 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:25.247434 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4a8d9fc9-e971-4d48-bfd8-61a179b1bdbe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:25.248056 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4a8d9fc9-e971-4d48-bfd8-61a179b1bdbe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:25.254107 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4a8d9fc9-e971-4d48-bfd8-61a179b1bdbe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:25.254560 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4a8d9fc9-e971-4d48-bfd8-61a179b1bdbe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:25.255366 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4a8d9fc9-e971-4d48-bfd8-61a179b1bdbe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:25.255808 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4a8d9fc9-e971-4d48-bfd8-61a179b1bdbe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:25.380733 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4a8d9fc9-e971-4d48-bfd8-61a179b1bdbe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:25.388123 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4a8d9fc9-e971-4d48-bfd8-61a179b1bdbe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1682 microversion: 2.1 time: 0.144766 May 12 14:38:25.388704 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 413/801] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:25 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1682 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:25.837376 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7e2d3c7d-b5a2-43c7-956b-f15c5f1308fa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:25.837998 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7e2d3c7d-b5a2-43c7-956b-f15c5f1308fa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:25.844022 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7e2d3c7d-b5a2-43c7-956b-f15c5f1308fa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:25.844469 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7e2d3c7d-b5a2-43c7-956b-f15c5f1308fa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:25.845227 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7e2d3c7d-b5a2-43c7-956b-f15c5f1308fa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:25.845658 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7e2d3c7d-b5a2-43c7-956b-f15c5f1308fa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:25.974425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7e2d3c7d-b5a2-43c7-956b-f15c5f1308fa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:25.981770 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7e2d3c7d-b5a2-43c7-956b-f15c5f1308fa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.148798 May 12 14:38:25.982336 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 389/802] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:25 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:26.121731 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ff8b7389-b852-46ec-aa22-04050388a097 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:26.122281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ff8b7389-b852-46ec-aa22-04050388a097 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:26.128525 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ff8b7389-b852-46ec-aa22-04050388a097 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:26.128979 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ff8b7389-b852-46ec-aa22-04050388a097 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:26.129760 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ff8b7389-b852-46ec-aa22-04050388a097 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:26.130199 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ff8b7389-b852-46ec-aa22-04050388a097 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:26.258325 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ff8b7389-b852-46ec-aa22-04050388a097 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:26.266300 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ff8b7389-b852-46ec-aa22-04050388a097 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1277 microversion: 2.1 time: 0.148674 May 12 14:38:26.266895 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 414/803] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:26 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:26.405122 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-096e4939-387e-4d8a-a051-bf610a544a55 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:26.406299 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-096e4939-387e-4d8a-a051-bf610a544a55 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:26.412171 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-096e4939-387e-4d8a-a051-bf610a544a55 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:26.412615 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-096e4939-387e-4d8a-a051-bf610a544a55 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:26.413371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-096e4939-387e-4d8a-a051-bf610a544a55 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:26.413802 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-096e4939-387e-4d8a-a051-bf610a544a55 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:26.536145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-096e4939-387e-4d8a-a051-bf610a544a55 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:26.543343 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-096e4939-387e-4d8a-a051-bf610a544a55 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1682 microversion: 2.1 time: 0.142231 May 12 14:38:26.543914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 390/804] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:26 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1682 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:26.999714 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a30ceb58-1652-4ad6-ab9f-5485d512e3aa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:27.000342 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a30ceb58-1652-4ad6-ab9f-5485d512e3aa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:27.006194 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a30ceb58-1652-4ad6-ab9f-5485d512e3aa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:27.006649 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a30ceb58-1652-4ad6-ab9f-5485d512e3aa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.007457 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a30ceb58-1652-4ad6-ab9f-5485d512e3aa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:27.007900 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a30ceb58-1652-4ad6-ab9f-5485d512e3aa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.132856 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a30ceb58-1652-4ad6-ab9f-5485d512e3aa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:27.140552 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a30ceb58-1652-4ad6-ab9f-5485d512e3aa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.144915 May 12 14:38:27.141120 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 415/805] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:26 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:27.283480 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d45e9fed-bb79-46be-a62b-958e5811f167 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:27.283997 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d45e9fed-bb79-46be-a62b-958e5811f167 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:27.290347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d45e9fed-bb79-46be-a62b-958e5811f167 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:27.290816 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d45e9fed-bb79-46be-a62b-958e5811f167 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.291594 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d45e9fed-bb79-46be-a62b-958e5811f167 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:27.292031 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d45e9fed-bb79-46be-a62b-958e5811f167 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.418213 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d45e9fed-bb79-46be-a62b-958e5811f167 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:27.425523 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d45e9fed-bb79-46be-a62b-958e5811f167 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1277 microversion: 2.1 time: 0.146680 May 12 14:38:27.426086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 391/806] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:27 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:27.560293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-cee09e00-9aba-430c-8e61-e5d28cfe58b8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:27.560844 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-cee09e00-9aba-430c-8e61-e5d28cfe58b8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:27.567207 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cee09e00-9aba-430c-8e61-e5d28cfe58b8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:27.567665 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cee09e00-9aba-430c-8e61-e5d28cfe58b8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.568438 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cee09e00-9aba-430c-8e61-e5d28cfe58b8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:27.568876 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cee09e00-9aba-430c-8e61-e5d28cfe58b8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:27.699011 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-cee09e00-9aba-430c-8e61-e5d28cfe58b8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:27.706943 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-cee09e00-9aba-430c-8e61-e5d28cfe58b8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1682 microversion: 2.1 time: 0.150555 May 12 14:38:27.707548 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 416/807] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:27 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:28.157918 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-644303f8-f07e-4c81-8814-05b7c47e4646 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:28.158439 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-644303f8-f07e-4c81-8814-05b7c47e4646 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:28.164595 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-644303f8-f07e-4c81-8814-05b7c47e4646 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:28.165042 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-644303f8-f07e-4c81-8814-05b7c47e4646 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:28.165817 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-644303f8-f07e-4c81-8814-05b7c47e4646 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:28.166246 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-644303f8-f07e-4c81-8814-05b7c47e4646 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:28.443183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0a2cd807-ebd2-45a7-9ff4-0a17d108fb5d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:28.443736 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0a2cd807-ebd2-45a7-9ff4-0a17d108fb5d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:28.450327 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0a2cd807-ebd2-45a7-9ff4-0a17d108fb5d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:28.450777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0a2cd807-ebd2-45a7-9ff4-0a17d108fb5d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:28.451594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0a2cd807-ebd2-45a7-9ff4-0a17d108fb5d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:28.452710 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0a2cd807-ebd2-45a7-9ff4-0a17d108fb5d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:28.786475 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-644303f8-f07e-4c81-8814-05b7c47e4646 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:28.793625 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-644303f8-f07e-4c81-8814-05b7c47e4646 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.640359 May 12 14:38:28.794195 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 392/808] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:28 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:28.800623 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-371cf06e-f553-4e05-a0c4-878cfaa34208 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:28.801449 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-371cf06e-f553-4e05-a0c4-878cfaa34208 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:28.807772 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-371cf06e-f553-4e05-a0c4-878cfaa34208 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:28.808227 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-371cf06e-f553-4e05-a0c4-878cfaa34208 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:28.809004 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-371cf06e-f553-4e05-a0c4-878cfaa34208 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:28.809437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-371cf06e-f553-4e05-a0c4-878cfaa34208 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:28.955586 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0a2cd807-ebd2-45a7-9ff4-0a17d108fb5d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:28.962299 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0a2cd807-ebd2-45a7-9ff4-0a17d108fb5d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1265 microversion: 2.1 time: 0.522902 May 12 14:38:28.972860 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 417/809] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:28 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1265 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:29.193362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-371cf06e-f553-4e05-a0c4-878cfaa34208 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:29.202642 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-371cf06e-f553-4e05-a0c4-878cfaa34208 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1682 microversion: 2.1 time: 0.407256 May 12 14:38:29.212699 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 393/810] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:28 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1682 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:29.813136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d2f8f802-a511-4697-bf1f-78d280acecb8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:29.813136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d2f8f802-a511-4697-bf1f-78d280acecb8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:29.820197 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d2f8f802-a511-4697-bf1f-78d280acecb8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:29.820587 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d2f8f802-a511-4697-bf1f-78d280acecb8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:29.821380 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d2f8f802-a511-4697-bf1f-78d280acecb8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:29.821857 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d2f8f802-a511-4697-bf1f-78d280acecb8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:29.979709 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-84d12dad-fc36-4552-a9a4-47bfb48ef573 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:29.981672 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-84d12dad-fc36-4552-a9a4-47bfb48ef573 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:29.988096 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84d12dad-fc36-4552-a9a4-47bfb48ef573 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:29.988553 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84d12dad-fc36-4552-a9a4-47bfb48ef573 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:29.989343 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84d12dad-fc36-4552-a9a4-47bfb48ef573 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:29.989788 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84d12dad-fc36-4552-a9a4-47bfb48ef573 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.411589 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d2f8f802-a511-4697-bf1f-78d280acecb8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:30.422046 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d2f8f802-a511-4697-bf1f-78d280acecb8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.614675 May 12 14:38:30.423220 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 418/811] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:29 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:30.436553 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-fc9348bc-6dca-4346-bcad-db99e4de2c7c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:30.440038 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-fc9348bc-6dca-4346-bcad-db99e4de2c7c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:30.448964 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fc9348bc-6dca-4346-bcad-db99e4de2c7c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.449769 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fc9348bc-6dca-4346-bcad-db99e4de2c7c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.450687 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fc9348bc-6dca-4346-bcad-db99e4de2c7c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.451282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fc9348bc-6dca-4346-bcad-db99e4de2c7c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.651386 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-84d12dad-fc36-4552-a9a4-47bfb48ef573 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:30.659527 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-84d12dad-fc36-4552-a9a4-47bfb48ef573 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1265 microversion: 2.1 time: 0.683691 May 12 14:38:30.660121 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 394/812] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:29 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1265 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:30.665661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-280f1237-14f9-46c5-8b3c-05002867f625 req-5dfecce3-9a88-41d9-862d-d09fea0d72a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c45819a2-89a0-494b-bdbc-650fcfddd2cd", "tag": "10ba03ca-52fe-42dc-a95e-573a96e2bd48"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:30.674997 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-280f1237-14f9-46c5-8b3c-05002867f625 req-5dfecce3-9a88-41d9-862d-d09fea0d72a9 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:30.675484 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-280f1237-14f9-46c5-8b3c-05002867f625 req-5dfecce3-9a88-41d9-862d-d09fea0d72a9 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:30.686208 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-280f1237-14f9-46c5-8b3c-05002867f625 req-5dfecce3-9a88-41d9-862d-d09fea0d72a9 service nova] Creating event network-changed:10ba03ca-52fe-42dc-a95e-573a96e2bd48 for instance c45819a2-89a0-494b-bdbc-650fcfddd2cd on hv-cinder-77703 May 12 14:38:30.691181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-280f1237-14f9-46c5-8b3c-05002867f625 req-5dfecce3-9a88-41d9-862d-d09fea0d72a9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028964 May 12 14:38:30.691788 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 395/813] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:31.191455 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-fc65dd98-50bb-4f82-88f0-9cedc0d49cb2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:31.192116 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-fc65dd98-50bb-4f82-88f0-9cedc0d49cb2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:31.198078 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fc65dd98-50bb-4f82-88f0-9cedc0d49cb2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.198530 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fc65dd98-50bb-4f82-88f0-9cedc0d49cb2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.199346 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fc65dd98-50bb-4f82-88f0-9cedc0d49cb2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.199788 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fc65dd98-50bb-4f82-88f0-9cedc0d49cb2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.227672 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-fc65dd98-50bb-4f82-88f0-9cedc0d49cb2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments/ed9d2580-4f14-49ba-8a5a-eca41ae39038" status: 200 len: 194 microversion: 2.20 time: 0.040880 May 12 14:38:31.228182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 396/814] 10.222.0.75 () {60 vars in 1453 bytes} [Thu May 12 14:38:31 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments/ed9d2580-4f14-49ba-8a5a-eca41ae39038 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:38:31.291048 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e1df98fe-d634-4feb-922c-33dd5cb602e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:31.291563 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e1df98fe-d634-4feb-922c-33dd5cb602e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:31.291786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-fc9348bc-6dca-4346-bcad-db99e4de2c7c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:31.298218 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1df98fe-d634-4feb-922c-33dd5cb602e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.298672 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1df98fe-d634-4feb-922c-33dd5cb602e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.299492 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1df98fe-d634-4feb-922c-33dd5cb602e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.299934 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e1df98fe-d634-4feb-922c-33dd5cb602e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.302526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-fc9348bc-6dca-4346-bcad-db99e4de2c7c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1682 microversion: 2.1 time: 0.877898 May 12 14:38:31.313212 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 419/815] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:30 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1682 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:31.385842 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-e1df98fe-d634-4feb-922c-33dd5cb602e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lazy-loading 'services' on Instance uuid d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:38:31.440178 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f545f0b6-80f6-4ee3-8027-2db5723c0647 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:31.441034 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f545f0b6-80f6-4ee3-8027-2db5723c0647 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:31.449247 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f545f0b6-80f6-4ee3-8027-2db5723c0647 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.453822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f545f0b6-80f6-4ee3-8027-2db5723c0647 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.455810 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f545f0b6-80f6-4ee3-8027-2db5723c0647 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.456397 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f545f0b6-80f6-4ee3-8027-2db5723c0647 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.465012 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e1df98fe-d634-4feb-922c-33dd5cb602e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments/ed9d2580-4f14-49ba-8a5a-eca41ae39038" status: 202 len: 0 microversion: 2.20 time: 0.177764 May 12 14:38:31.465755 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 397/816] 10.222.0.75 () {60 vars in 1456 bytes} [Thu May 12 14:38:31 2022] DELETE /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments/ed9d2580-4f14-49ba-8a5a-eca41ae39038 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 12 14:38:31.487249 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-5274a44c-faee-4783-8758-ee413b71a29e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:31.488346 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-5274a44c-faee-4783-8758-ee413b71a29e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:31.495650 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5274a44c-faee-4783-8758-ee413b71a29e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.496625 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5274a44c-faee-4783-8758-ee413b71a29e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.498443 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5274a44c-faee-4783-8758-ee413b71a29e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.499194 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5274a44c-faee-4783-8758-ee413b71a29e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.531069 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-5274a44c-faee-4783-8758-ee413b71a29e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051546 May 12 14:38:31.535175 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 398/817] 10.222.0.75 () {60 vars in 1342 bytes} [Thu May 12 14:38:31 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:38:31.676677 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-87db467d-dc5a-41ee-b3ef-ff5662162973 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:31.677286 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-87db467d-dc5a-41ee-b3ef-ff5662162973 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:31.683063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-87db467d-dc5a-41ee-b3ef-ff5662162973 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.683526 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-87db467d-dc5a-41ee-b3ef-ff5662162973 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.684323 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-87db467d-dc5a-41ee-b3ef-ff5662162973 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:31.684758 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-87db467d-dc5a-41ee-b3ef-ff5662162973 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:31.736978 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f545f0b6-80f6-4ee3-8027-2db5723c0647 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:31.744347 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f545f0b6-80f6-4ee3-8027-2db5723c0647 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.309712 May 12 14:38:31.744962 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 420/818] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:31 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:32.064324 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-87db467d-dc5a-41ee-b3ef-ff5662162973 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:32.074205 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-87db467d-dc5a-41ee-b3ef-ff5662162973 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1265 microversion: 2.1 time: 0.401181 May 12 14:38:32.074804 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 399/819] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:31 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1265 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:32.320404 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2ac184c1-9298-4a39-9ae9-42513158af94 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:32.321027 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2ac184c1-9298-4a39-9ae9-42513158af94 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:32.328106 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2ac184c1-9298-4a39-9ae9-42513158af94 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:32.328569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2ac184c1-9298-4a39-9ae9-42513158af94 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:32.329384 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2ac184c1-9298-4a39-9ae9-42513158af94 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:32.329829 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2ac184c1-9298-4a39-9ae9-42513158af94 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:32.393783 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2ac184c1-9298-4a39-9ae9-42513158af94 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:32.402453 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2ac184c1-9298-4a39-9ae9-42513158af94 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1614 microversion: 2.1 time: 0.085881 May 12 14:38:32.403060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 421/820] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:32 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:32.542974 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-821e4a1c-3638-47c2-95ec-224574127662 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:32.543848 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-821e4a1c-3638-47c2-95ec-224574127662 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:32.549990 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-821e4a1c-3638-47c2-95ec-224574127662 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:32.550436 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-821e4a1c-3638-47c2-95ec-224574127662 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:32.551230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-821e4a1c-3638-47c2-95ec-224574127662 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:32.551668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-821e4a1c-3638-47c2-95ec-224574127662 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:32.580258 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-821e4a1c-3638-47c2-95ec-224574127662 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041260 May 12 14:38:32.580820 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 400/821] 10.222.0.75 () {60 vars in 1342 bytes} [Thu May 12 14:38:32 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:38:32.724109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-c3ee0a98-3436-48c6-9527-c1e7abc372bb req-6d343d82-055f-47d3-9874-6fe64bd4496b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7740cfd0-aec5-4a22-93f7-a460cadea4ac", "tag": "5dfbc34b-96be-4bb8-98e9-1380f31b1266"}, {"server_uuid": "1fab0a31-9c59-40c0-8350-788bf0458078", "name": "network-vif-deleted", "tag": "c3aac594-e895-4346-8c61-7bc47bc88813"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:32.733031 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-c3ee0a98-3436-48c6-9527-c1e7abc372bb req-6d343d82-055f-47d3-9874-6fe64bd4496b service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:32.733490 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-c3ee0a98-3436-48c6-9527-c1e7abc372bb req-6d343d82-055f-47d3-9874-6fe64bd4496b service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:32.745257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-c3ee0a98-3436-48c6-9527-c1e7abc372bb req-6d343d82-055f-47d3-9874-6fe64bd4496b service nova] Creating event network-changed:5dfbc34b-96be-4bb8-98e9-1380f31b1266 for instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac on hv-cinder-77703 May 12 14:38:32.746070 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-c3ee0a98-3436-48c6-9527-c1e7abc372bb req-6d343d82-055f-47d3-9874-6fe64bd4496b service nova] Creating event network-vif-deleted:c3aac594-e895-4346-8c61-7bc47bc88813 for instance 1fab0a31-9c59-40c0-8350-788bf0458078 on hv-cinder-77703 May 12 14:38:32.753038 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-c3ee0a98-3436-48c6-9527-c1e7abc372bb req-6d343d82-055f-47d3-9874-6fe64bd4496b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.032667 May 12 14:38:32.753644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 422/822] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:32.761640 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-103ab772-b8dc-4c22-be39-3895c3a99a45 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:32.762254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-103ab772-b8dc-4c22-be39-3895c3a99a45 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:32.769467 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-103ab772-b8dc-4c22-be39-3895c3a99a45 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:32.769928 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-103ab772-b8dc-4c22-be39-3895c3a99a45 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:32.770717 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-103ab772-b8dc-4c22-be39-3895c3a99a45 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:32.771204 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-103ab772-b8dc-4c22-be39-3895c3a99a45 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:32.900786 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-103ab772-b8dc-4c22-be39-3895c3a99a45 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:32.908419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-103ab772-b8dc-4c22-be39-3895c3a99a45 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.150545 May 12 14:38:32.909098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 401/823] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:32 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:33.091372 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-40ed9606-b191-44db-a220-c8f9040007bb tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:33.092074 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-40ed9606-b191-44db-a220-c8f9040007bb tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:33.098078 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-40ed9606-b191-44db-a220-c8f9040007bb tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:33.098532 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-40ed9606-b191-44db-a220-c8f9040007bb tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:33.099331 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-40ed9606-b191-44db-a220-c8f9040007bb tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:33.099770 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-40ed9606-b191-44db-a220-c8f9040007bb tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:33.232504 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-40ed9606-b191-44db-a220-c8f9040007bb tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:33.240388 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-40ed9606-b191-44db-a220-c8f9040007bb tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1265 microversion: 2.1 time: 0.153311 May 12 14:38:33.240964 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 423/824] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:33 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:33.419998 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3acee4bf-33b8-4057-828d-078ca2ddd687 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:33.421215 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3acee4bf-33b8-4057-828d-078ca2ddd687 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:33.427189 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3acee4bf-33b8-4057-828d-078ca2ddd687 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:33.427640 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3acee4bf-33b8-4057-828d-078ca2ddd687 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:33.428410 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3acee4bf-33b8-4057-828d-078ca2ddd687 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:33.428847 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3acee4bf-33b8-4057-828d-078ca2ddd687 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:33.488487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3acee4bf-33b8-4057-828d-078ca2ddd687 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:33.496112 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3acee4bf-33b8-4057-828d-078ca2ddd687 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1327 microversion: 2.1 time: 0.079703 May 12 14:38:33.496690 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 402/825] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:33 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1327 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:33.591423 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2baef205-4256-4253-8122-a7660ef7b362 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:33.592898 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2baef205-4256-4253-8122-a7660ef7b362 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:33.599248 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2baef205-4256-4253-8122-a7660ef7b362 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:33.599704 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2baef205-4256-4253-8122-a7660ef7b362 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:33.600474 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2baef205-4256-4253-8122-a7660ef7b362 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:33.600913 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2baef205-4256-4253-8122-a7660ef7b362 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:33.629735 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2baef205-4256-4253-8122-a7660ef7b362 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042263 May 12 14:38:33.630308 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 424/826] 10.222.0.75 () {60 vars in 1342 bytes} [Thu May 12 14:38:33 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:38:33.925320 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-52e1fd92-b24b-4593-8052-dcdcd132dadf tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:33.925969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-52e1fd92-b24b-4593-8052-dcdcd132dadf tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:33.932230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-52e1fd92-b24b-4593-8052-dcdcd132dadf tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:33.932682 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-52e1fd92-b24b-4593-8052-dcdcd132dadf tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:33.933442 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-52e1fd92-b24b-4593-8052-dcdcd132dadf tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:33.933880 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-52e1fd92-b24b-4593-8052-dcdcd132dadf tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.060676 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-52e1fd92-b24b-4593-8052-dcdcd132dadf tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:34.067817 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-52e1fd92-b24b-4593-8052-dcdcd132dadf tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.146361 May 12 14:38:34.068383 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 403/827] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:33 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:34.257834 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1d9921f1-8b51-43f1-8422-297f9b2fe033 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:34.258450 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1d9921f1-8b51-43f1-8422-297f9b2fe033 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:34.265005 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d9921f1-8b51-43f1-8422-297f9b2fe033 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.265405 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d9921f1-8b51-43f1-8422-297f9b2fe033 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.266176 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d9921f1-8b51-43f1-8422-297f9b2fe033 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.266634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d9921f1-8b51-43f1-8422-297f9b2fe033 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.391623 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1d9921f1-8b51-43f1-8422-297f9b2fe033 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:34.398787 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1d9921f1-8b51-43f1-8422-297f9b2fe033 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1265 microversion: 2.1 time: 0.144832 May 12 14:38:34.399373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 425/828] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:34 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:34.512035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-822f38f9-816a-49ea-9ba9-4aea19f63a21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:34.512646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-822f38f9-816a-49ea-9ba9-4aea19f63a21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:34.519270 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-822f38f9-816a-49ea-9ba9-4aea19f63a21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.519659 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-822f38f9-816a-49ea-9ba9-4aea19f63a21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.520419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-822f38f9-816a-49ea-9ba9-4aea19f63a21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.520854 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-822f38f9-816a-49ea-9ba9-4aea19f63a21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.550277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-822f38f9-816a-49ea-9ba9-4aea19f63a21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.550722 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-822f38f9-816a-49ea-9ba9-4aea19f63a21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.551196 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-822f38f9-816a-49ea-9ba9-4aea19f63a21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lazy-loading 'fault' on Instance uuid 1fab0a31-9c59-40c0-8350-788bf0458078 {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:38:34.589948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-822f38f9-816a-49ea-9ba9-4aea19f63a21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:34.597201 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-822f38f9-816a-49ea-9ba9-4aea19f63a21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1332 microversion: 2.1 time: 0.088989 May 12 14:38:34.597768 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 404/829] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:34 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1332 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:34.641341 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3beccc34-b289-4a9a-89cf-cf612b00e979 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:34.642271 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3beccc34-b289-4a9a-89cf-cf612b00e979 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:34.648540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3beccc34-b289-4a9a-89cf-cf612b00e979 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.648999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3beccc34-b289-4a9a-89cf-cf612b00e979 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.649771 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3beccc34-b289-4a9a-89cf-cf612b00e979 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:34.650219 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3beccc34-b289-4a9a-89cf-cf612b00e979 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:34.678517 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3beccc34-b289-4a9a-89cf-cf612b00e979 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041116 May 12 14:38:34.679090 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 426/830] 10.222.0.75 () {60 vars in 1342 bytes} [Thu May 12 14:38:34 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:38:35.084958 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0a2d63f0-3eea-4018-af55-55e300949518 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:35.085568 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0a2d63f0-3eea-4018-af55-55e300949518 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:35.091900 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0a2d63f0-3eea-4018-af55-55e300949518 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:35.092858 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0a2d63f0-3eea-4018-af55-55e300949518 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:35.093618 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0a2d63f0-3eea-4018-af55-55e300949518 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:35.094054 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0a2d63f0-3eea-4018-af55-55e300949518 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:35.219949 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0a2d63f0-3eea-4018-af55-55e300949518 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:35.226999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0a2d63f0-3eea-4018-af55-55e300949518 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.145896 May 12 14:38:35.227585 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 405/831] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:35 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:35.415275 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0d6e1806-0d91-49dc-96af-b1f52dd509c0 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:35.415899 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0d6e1806-0d91-49dc-96af-b1f52dd509c0 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:35.421878 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0d6e1806-0d91-49dc-96af-b1f52dd509c0 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:35.422330 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0d6e1806-0d91-49dc-96af-b1f52dd509c0 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:35.423130 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0d6e1806-0d91-49dc-96af-b1f52dd509c0 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:35.423575 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0d6e1806-0d91-49dc-96af-b1f52dd509c0 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:35.549858 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0d6e1806-0d91-49dc-96af-b1f52dd509c0 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:35.557075 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0d6e1806-0d91-49dc-96af-b1f52dd509c0 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1265 microversion: 2.1 time: 0.145658 May 12 14:38:35.557645 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 427/832] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:35 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:35.613318 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-03c189d3-d4c7-4a90-b21b-e4c1d13fcf83 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:35.613927 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-03c189d3-d4c7-4a90-b21b-e4c1d13fcf83 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:35.619733 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-03c189d3-d4c7-4a90-b21b-e4c1d13fcf83 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:35.620183 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-03c189d3-d4c7-4a90-b21b-e4c1d13fcf83 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:35.621197 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-03c189d3-d4c7-4a90-b21b-e4c1d13fcf83 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:35.621636 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-03c189d3-d4c7-4a90-b21b-e4c1d13fcf83 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:35.652683 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-03c189d3-d4c7-4a90-b21b-e4c1d13fcf83 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:35.653162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-03c189d3-d4c7-4a90-b21b-e4c1d13fcf83 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:35.653608 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-03c189d3-d4c7-4a90-b21b-e4c1d13fcf83 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lazy-loading 'fault' on Instance uuid 1fab0a31-9c59-40c0-8350-788bf0458078 {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:38:35.690413 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d1f995e1-0e1d-4a2a-83c0-9164a3ae9059 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:35.691418 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d1f995e1-0e1d-4a2a-83c0-9164a3ae9059 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:35.694086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-03c189d3-d4c7-4a90-b21b-e4c1d13fcf83 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:35.697740 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d1f995e1-0e1d-4a2a-83c0-9164a3ae9059 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:35.698193 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d1f995e1-0e1d-4a2a-83c0-9164a3ae9059 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:35.698960 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d1f995e1-0e1d-4a2a-83c0-9164a3ae9059 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:35.699427 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d1f995e1-0e1d-4a2a-83c0-9164a3ae9059 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:35.701314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-03c189d3-d4c7-4a90-b21b-e4c1d13fcf83 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1332 microversion: 2.1 time: 0.091783 May 12 14:38:35.702454 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 406/833] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:35 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:35.728090 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d1f995e1-0e1d-4a2a-83c0-9164a3ae9059 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042145 May 12 14:38:35.728667 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 428/834] 10.222.0.75 () {60 vars in 1342 bytes} [Thu May 12 14:38:35 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:38:36.243753 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-57c54bb1-8aba-4bfb-9a90-67d961e586e8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:36.244300 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-57c54bb1-8aba-4bfb-9a90-67d961e586e8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:36.251654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57c54bb1-8aba-4bfb-9a90-67d961e586e8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:36.252100 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57c54bb1-8aba-4bfb-9a90-67d961e586e8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:36.252862 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57c54bb1-8aba-4bfb-9a90-67d961e586e8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:36.253296 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-57c54bb1-8aba-4bfb-9a90-67d961e586e8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:36.482461 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-57c54bb1-8aba-4bfb-9a90-67d961e586e8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:36.490495 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-57c54bb1-8aba-4bfb-9a90-67d961e586e8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.250540 May 12 14:38:36.490968 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 407/835] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:36 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:36.574254 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e15b0b20-4c73-4840-997d-2ef758faa4df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:36.574865 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e15b0b20-4c73-4840-997d-2ef758faa4df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:36.580794 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e15b0b20-4c73-4840-997d-2ef758faa4df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:36.581247 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e15b0b20-4c73-4840-997d-2ef758faa4df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:36.582006 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e15b0b20-4c73-4840-997d-2ef758faa4df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:36.582444 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e15b0b20-4c73-4840-997d-2ef758faa4df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:36.718143 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7ab051e0-1627-43da-a528-8f5fe9b20e84 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:36.718790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7ab051e0-1627-43da-a528-8f5fe9b20e84 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:36.724603 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ab051e0-1627-43da-a528-8f5fe9b20e84 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:36.725068 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ab051e0-1627-43da-a528-8f5fe9b20e84 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:36.725842 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ab051e0-1627-43da-a528-8f5fe9b20e84 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:36.726287 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ab051e0-1627-43da-a528-8f5fe9b20e84 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:36.756808 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ab051e0-1627-43da-a528-8f5fe9b20e84 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:36.757259 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ab051e0-1627-43da-a528-8f5fe9b20e84 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:36.757714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-7ab051e0-1627-43da-a528-8f5fe9b20e84 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lazy-loading 'fault' on Instance uuid 1fab0a31-9c59-40c0-8350-788bf0458078 {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:38:36.815810 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7ab051e0-1627-43da-a528-8f5fe9b20e84 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:36.828516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7ab051e0-1627-43da-a528-8f5fe9b20e84 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1332 microversion: 2.1 time: 0.113982 May 12 14:38:36.828728 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 408/836] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:36 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:36.833409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-08e89755-9300-400d-aed2-f3cc7c054e17 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:36.834374 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-08e89755-9300-400d-aed2-f3cc7c054e17 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:36.840229 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-08e89755-9300-400d-aed2-f3cc7c054e17 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:36.840683 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-08e89755-9300-400d-aed2-f3cc7c054e17 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:36.841453 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-08e89755-9300-400d-aed2-f3cc7c054e17 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:36.841889 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-08e89755-9300-400d-aed2-f3cc7c054e17 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:36.848679 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e15b0b20-4c73-4840-997d-2ef758faa4df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:36.856243 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e15b0b20-4c73-4840-997d-2ef758faa4df tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1265 microversion: 2.1 time: 0.285839 May 12 14:38:36.856824 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 429/837] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:36 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:36.871458 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-08e89755-9300-400d-aed2-f3cc7c054e17 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041817 May 12 14:38:36.872012 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 409/838] 10.222.0.75 () {60 vars in 1342 bytes} [Thu May 12 14:38:36 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:38:37.506625 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-33ba31b6-ca45-43ae-b64c-0a6a22efd4a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:37.507260 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-33ba31b6-ca45-43ae-b64c-0a6a22efd4a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:37.513204 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33ba31b6-ca45-43ae-b64c-0a6a22efd4a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.513653 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33ba31b6-ca45-43ae-b64c-0a6a22efd4a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.515004 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33ba31b6-ca45-43ae-b64c-0a6a22efd4a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.515466 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33ba31b6-ca45-43ae-b64c-0a6a22efd4a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.643391 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-33ba31b6-ca45-43ae-b64c-0a6a22efd4a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:37.650554 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-33ba31b6-ca45-43ae-b64c-0a6a22efd4a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.147753 May 12 14:38:37.651140 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 430/839] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:37 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:37.844799 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f9d6c78f-4cb2-4bb8-8414-bc597e461ddd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:37.845424 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f9d6c78f-4cb2-4bb8-8414-bc597e461ddd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:37.851580 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f9d6c78f-4cb2-4bb8-8414-bc597e461ddd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.852033 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f9d6c78f-4cb2-4bb8-8414-bc597e461ddd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.852805 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f9d6c78f-4cb2-4bb8-8414-bc597e461ddd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.853243 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f9d6c78f-4cb2-4bb8-8414-bc597e461ddd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.872750 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-fa30bf84-48ab-4aad-9d19-3451bde20030 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:37.874205 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-fa30bf84-48ab-4aad-9d19-3451bde20030 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:37.880531 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fa30bf84-48ab-4aad-9d19-3451bde20030 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.880979 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fa30bf84-48ab-4aad-9d19-3451bde20030 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.881753 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fa30bf84-48ab-4aad-9d19-3451bde20030 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.882196 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fa30bf84-48ab-4aad-9d19-3451bde20030 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.884162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f9d6c78f-4cb2-4bb8-8414-bc597e461ddd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.884619 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f9d6c78f-4cb2-4bb8-8414-bc597e461ddd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.885073 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-f9d6c78f-4cb2-4bb8-8414-bc597e461ddd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lazy-loading 'fault' on Instance uuid 1fab0a31-9c59-40c0-8350-788bf0458078 {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:38:37.926379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f9d6c78f-4cb2-4bb8-8414-bc597e461ddd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:37.933634 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f9d6c78f-4cb2-4bb8-8414-bc597e461ddd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 200 len: 1332 microversion: 2.1 time: 0.092684 May 12 14:38:37.934205 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 410/840] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:37 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:37.943375 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4b69a6f8-e88c-4ae5-b272-414779272289 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:37.944298 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4b69a6f8-e88c-4ae5-b272-414779272289 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:37.950438 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4b69a6f8-e88c-4ae5-b272-414779272289 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.950887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4b69a6f8-e88c-4ae5-b272-414779272289 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.951713 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4b69a6f8-e88c-4ae5-b272-414779272289 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:37.952153 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4b69a6f8-e88c-4ae5-b272-414779272289 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:37.982559 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4b69a6f8-e88c-4ae5-b272-414779272289 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047286 May 12 14:38:37.987258 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 411/841] 10.222.0.75 () {60 vars in 1342 bytes} [Thu May 12 14:38:37 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:38:38.108525 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-fa30bf84-48ab-4aad-9d19-3451bde20030 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:38.116246 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-fa30bf84-48ab-4aad-9d19-3451bde20030 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1265 microversion: 2.1 time: 0.247499 May 12 14:38:38.125896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 431/842] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:37 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:38.667950 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-bbc20ffd-b309-4bf6-98d3-76f88e0587a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:38.668517 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-bbc20ffd-b309-4bf6-98d3-76f88e0587a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:38.674605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bbc20ffd-b309-4bf6-98d3-76f88e0587a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:38.675119 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bbc20ffd-b309-4bf6-98d3-76f88e0587a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:38.675941 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bbc20ffd-b309-4bf6-98d3-76f88e0587a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:38.676387 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bbc20ffd-b309-4bf6-98d3-76f88e0587a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:38.899998 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-bbc20ffd-b309-4bf6-98d3-76f88e0587a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:38.907345 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-bbc20ffd-b309-4bf6-98d3-76f88e0587a6 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.243382 May 12 14:38:38.907921 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 412/843] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:38 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:38.950872 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a5ab724e-10fc-4dd5-92cc-656485efeb0e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:38.952268 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a5ab724e-10fc-4dd5-92cc-656485efeb0e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:38.958495 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a5ab724e-10fc-4dd5-92cc-656485efeb0e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:38.958948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a5ab724e-10fc-4dd5-92cc-656485efeb0e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:38.959748 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a5ab724e-10fc-4dd5-92cc-656485efeb0e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:38.960187 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a5ab724e-10fc-4dd5-92cc-656485efeb0e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:38.973420 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-a5ab724e-10fc-4dd5-92cc-656485efeb0e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] HTTP exception thrown: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a5ab724e-10fc-4dd5-92cc-656485efeb0e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Request method failure captured: May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 HTTP/1.1 May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRo-ycWfHqPPxbmLiuTXrtXJLZwYU78oTuGhPDkiQSHU7CKcy_GQqpZ_HWFwpOkfP_a2cy2OZwfawJtQIkHx1tZyLxJZoQOwjSpujcF6pQ0BcV3O7kKLbSCm6-7BGei9mU5XP-t1FCFU5rK_O_aRKcjHsdbD5yR-8mP9_YNetCjLQkw May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:38:38.975428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:38:38.976996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4b5ca018b5f4dda99486407424b8168", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:38:38.976996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-AttachVolumeNegativeTest-523912070 May 12 14:38:38.976996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:38:38.976996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:38:38.976996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:38:38.976996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:38:38.976996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:38:38.976996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: c6422873a3b84aac88f8a93291bcd7b0 May 12 14:38:38.976996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:38:38.976996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:38:38.976996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. May 12 14:38:38.976996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': '1fab0a31-9c59-40c0-8350-788bf0458078'} May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:38:38.977838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. May 12 14:38:38.979644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:38:38.980759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a5ab724e-10fc-4dd5-92cc-656485efeb0e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Returning 404 to user: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:38:38.980759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a5ab724e-10fc-4dd5-92cc-656485efeb0e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 404 len: 111 microversion: 2.1 time: 0.029955 May 12 14:38:38.980759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 432/844] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:38 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:38:38.985767 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0ffbb9e6-85bc-475a-af9f-93782a7f05c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '.version_select at 0x7f5b26090b80>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:38.994176 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-207881f6-2bef-474a-ba7e-9beae3076051 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:38.995127 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-207881f6-2bef-474a-ba7e-9beae3076051 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:39.001910 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-207881f6-2bef-474a-ba7e-9beae3076051 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.002360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-207881f6-2bef-474a-ba7e-9beae3076051 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.003158 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-207881f6-2bef-474a-ba7e-9beae3076051 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.003601 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-207881f6-2bef-474a-ba7e-9beae3076051 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.011167 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0ffbb9e6-85bc-475a-af9f-93782a7f05c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639837625" status: 202 len: 0 microversion: 2.1 time: 0.029187 May 12 14:38:39.011758 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 413/845] 10.222.0.75 () {58 vars in 1220 bytes} [Thu May 12 14:38:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639837625 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:38:39.038819 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-207881f6-2bef-474a-ba7e-9beae3076051 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047561 May 12 14:38:39.038819 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 433/846] 10.222.0.75 () {60 vars in 1342 bytes} [Thu May 12 14:38:38 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:39.110409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-757db087-b4a6-4043-b5b8-6d6636a60083 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:39.111005 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-757db087-b4a6-4043-b5b8-6d6636a60083 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:39.117017 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-757db087-b4a6-4043-b5b8-6d6636a60083 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.117475 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-757db087-b4a6-4043-b5b8-6d6636a60083 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.118264 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-757db087-b4a6-4043-b5b8-6d6636a60083 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.118843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-757db087-b4a6-4043-b5b8-6d6636a60083 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.133656 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ff8c7be1-baf3-451a-b932-a9c4d5a0a17a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:39.134272 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ff8c7be1-baf3-451a-b932-a9c4d5a0a17a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:39.140257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ff8c7be1-baf3-451a-b932-a9c4d5a0a17a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.140960 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ff8c7be1-baf3-451a-b932-a9c4d5a0a17a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.141737 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ff8c7be1-baf3-451a-b932-a9c4d5a0a17a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.142330 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ff8c7be1-baf3-451a-b932-a9c4d5a0a17a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.148153 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-757db087-b4a6-4043-b5b8-6d6636a60083 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Going to try to terminate instance {{(pid=118216) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:38:39.259361 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-757db087-b4a6-4043-b5b8-6d6636a60083 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 204 len: 0 microversion: 2.20 time: 0.152870 May 12 14:38:39.263770 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 414/847] 10.222.0.75 () {60 vars in 1279 bytes} [Thu May 12 14:38:39 2022] DELETE /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 14:38:39.274399 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-eb259eb3-d401-41d8-bdbf-08c3e97d627f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:39.275613 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-eb259eb3-d401-41d8-bdbf-08c3e97d627f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:39.282703 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb259eb3-d401-41d8-bdbf-08c3e97d627f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.283395 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb259eb3-d401-41d8-bdbf-08c3e97d627f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.284555 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb259eb3-d401-41d8-bdbf-08c3e97d627f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.285064 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb259eb3-d401-41d8-bdbf-08c3e97d627f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.340213 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ff8c7be1-baf3-451a-b932-a9c4d5a0a17a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:39.357024 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ff8c7be1-baf3-451a-b932-a9c4d5a0a17a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1265 microversion: 2.1 time: 0.227429 May 12 14:38:39.358396 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 434/848] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:39 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:39.442619 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-eb259eb3-d401-41d8-bdbf-08c3e97d627f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:39.450581 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-eb259eb3-d401-41d8-bdbf-08c3e97d627f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:39.452267 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-eb259eb3-d401-41d8-bdbf-08c3e97d627f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:39.453490 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-eb259eb3-d401-41d8-bdbf-08c3e97d627f tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.185120 May 12 14:38:39.453989 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 415/849] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:38:39 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:39.745892 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-430cd4a7-d2de-454c-a452-8ef139e85a02 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Action: 'create', calling method: .version_select at 0x7f5b268d70d0>, body: {"keypair": {"name": "tempest-keypair-1312984141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxkt1oz9tJlwT31AEeNRLPLG2fLEFvdxfWAMMjfQLf/5Jv/tri9MrmJOZG/odnKOPWm3v5A9Xmfw+RqEivm8gYaIPtFSLz61L/y4FzailuDt5WJQ9D74EerKUyWDhlPpg=="}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:39.767453 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-430cd4a7-d2de-454c-a452-8ef139e85a02 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for project e4b5ca018b5f4dda99486407424b8168. Resources: {'key_pairs'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:38:39.776506 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-430cd4a7-d2de-454c-a452-8ef139e85a02 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for user c6422873a3b84aac88f8a93291bcd7b0 and project e4b5ca018b5f4dda99486407424b8168. Resources: {'key_pairs'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:38:39.798857 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-430cd4a7-d2de-454c-a452-8ef139e85a02 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057256 May 12 14:38:39.799491 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 435/850] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 12 14:38:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:38:39.924831 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f9957604-7bf5-4079-a64d-f87e3db4b25f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:39.925440 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f9957604-7bf5-4079-a64d-f87e3db4b25f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:39.931986 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f9957604-7bf5-4079-a64d-f87e3db4b25f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.932443 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f9957604-7bf5-4079-a64d-f87e3db4b25f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:39.933228 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f9957604-7bf5-4079-a64d-f87e3db4b25f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:39.933715 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f9957604-7bf5-4079-a64d-f87e3db4b25f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:40.116139 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f9957604-7bf5-4079-a64d-f87e3db4b25f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:40.133923 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f9957604-7bf5-4079-a64d-f87e3db4b25f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.211296 May 12 14:38:40.133923 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 416/851] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:39 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:40.375360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e7e30c75-2cf4-4353-af84-1d4088d68471 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:40.376267 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e7e30c75-2cf4-4353-af84-1d4088d68471 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:40.382425 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e7e30c75-2cf4-4353-af84-1d4088d68471 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:40.383155 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e7e30c75-2cf4-4353-af84-1d4088d68471 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:40.384130 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e7e30c75-2cf4-4353-af84-1d4088d68471 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:40.384781 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e7e30c75-2cf4-4353-af84-1d4088d68471 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:40.472921 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9b499015-c972-455a-aba0-5a6063a61946 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:40.474297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9b499015-c972-455a-aba0-5a6063a61946 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:40.480570 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9b499015-c972-455a-aba0-5a6063a61946 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:40.481022 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9b499015-c972-455a-aba0-5a6063a61946 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:40.481845 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9b499015-c972-455a-aba0-5a6063a61946 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:40.482547 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9b499015-c972-455a-aba0-5a6063a61946 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:40.663511 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e7e30c75-2cf4-4353-af84-1d4088d68471 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:40.671816 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e7e30c75-2cf4-4353-af84-1d4088d68471 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1265 microversion: 2.1 time: 0.302001 May 12 14:38:40.672384 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 436/852] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:40 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:40.722958 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9b499015-c972-455a-aba0-5a6063a61946 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:40.731426 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-3d918820-2af0-4a6c-b4b4-47f191e0e2d2 req-9a3d4df8-f556-4a2f-81a0-00a521ca2298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7740cfd0-aec5-4a22-93f7-a460cadea4ac", "name": "network-vif-plugged", "status": "completed", "tag": "5dfbc34b-96be-4bb8-98e9-1380f31b1266"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:40.738947 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9b499015-c972-455a-aba0-5a6063a61946 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:40.740628 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9b499015-c972-455a-aba0-5a6063a61946 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:40.740881 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-3d918820-2af0-4a6c-b4b4-47f191e0e2d2 req-9a3d4df8-f556-4a2f-81a0-00a521ca2298 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:40.741345 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-3d918820-2af0-4a6c-b4b4-47f191e0e2d2 req-9a3d4df8-f556-4a2f-81a0-00a521ca2298 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:40.742118 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9b499015-c972-455a-aba0-5a6063a61946 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.273840 May 12 14:38:40.743022 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 417/853] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:38:40 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:38:40.763630 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-3d918820-2af0-4a6c-b4b4-47f191e0e2d2 req-9a3d4df8-f556-4a2f-81a0-00a521ca2298 service nova] Creating event network-vif-plugged:5dfbc34b-96be-4bb8-98e9-1380f31b1266 for instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac on hv-cinder-77703 May 12 14:38:40.768776 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-3d918820-2af0-4a6c-b4b4-47f191e0e2d2 req-9a3d4df8-f556-4a2f-81a0-00a521ca2298 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095083 May 12 14:38:40.769470 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 437/854] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:41.149776 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0a38e4b1-7972-4100-bad5-899967047b11 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:41.150434 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0a38e4b1-7972-4100-bad5-899967047b11 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:41.157332 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0a38e4b1-7972-4100-bad5-899967047b11 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.157784 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0a38e4b1-7972-4100-bad5-899967047b11 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:41.158563 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0a38e4b1-7972-4100-bad5-899967047b11 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.159005 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0a38e4b1-7972-4100-bad5-899967047b11 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:41.361108 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0a38e4b1-7972-4100-bad5-899967047b11 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:41.368544 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0a38e4b1-7972-4100-bad5-899967047b11 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.222720 May 12 14:38:41.369132 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 418/855] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:41 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:41.398401 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1133856450", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fdc0b19-4053-4c44-8b08-cd1ab3959461"}], "security_groups": [{"name": "tempest-securitygroup--578312772"}], "key_name": "tempest-keypair-1312984141", "user_data": "}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:41.504120 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.network.neutron [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] validate_networks() for [('3fdc0b19-4053-4c44-8b08-cd1ab3959461', None, None, None, None, None)] {{(pid=118217) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:38:41.689220 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4c730bb0-0d6b-447d-96b5-452e4b516ec3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:41.689840 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4c730bb0-0d6b-447d-96b5-452e4b516ec3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:41.695704 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c730bb0-0d6b-447d-96b5-452e4b516ec3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.696161 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c730bb0-0d6b-447d-96b5-452e4b516ec3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:41.696939 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c730bb0-0d6b-447d-96b5-452e4b516ec3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.697382 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c730bb0-0d6b-447d-96b5-452e4b516ec3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:41.919967 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4c730bb0-0d6b-447d-96b5-452e4b516ec3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:41.927158 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4c730bb0-0d6b-447d-96b5-452e4b516ec3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1265 microversion: 2.1 time: 0.242368 May 12 14:38:41.927732 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 419/856] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:41 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:41.941296 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1389aed6-7953-45d2-8c81-146457111bcc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:41.941911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1389aed6-7953-45d2-8c81-146457111bcc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:41.942269 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Flavor limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:38:41.942692 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Image limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:38:41.943200 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Flavor pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:38:41.943619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Image pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:38:41.944029 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:38:41.947930 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1389aed6-7953-45d2-8c81-146457111bcc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.948382 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1389aed6-7953-45d2-8c81-146457111bcc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:41.949161 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1389aed6-7953-45d2-8c81-146457111bcc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.949600 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1389aed6-7953-45d2-8c81-146457111bcc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:41.953287 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.953732 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:41.954528 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:41.955250 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:41.973207 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for project e4b5ca018b5f4dda99486407424b8168. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:38:41.978526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for user c6422873a3b84aac88f8a93291bcd7b0 and project e4b5ca018b5f4dda99486407424b8168. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:38:41.990475 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Going to run 1 instances... {{(pid=118217) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:38:41.993818 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:38:42.041356 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-38526be7-bdff-47e6-bc07-e4687f25c3c7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.647929 May 12 14:38:42.042389 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 438/857] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:38:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 14:38:42.085085 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1389aed6-7953-45d2-8c81-146457111bcc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:42.099659 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1389aed6-7953-45d2-8c81-146457111bcc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:42.101190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1389aed6-7953-45d2-8c81-146457111bcc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:42.102609 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1389aed6-7953-45d2-8c81-146457111bcc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1722 microversion: 2.20 time: 0.165077 May 12 14:38:42.114430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 420/858] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:38:41 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:42.114430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ac47dab1-71eb-4532-82f4-65d12972c457 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:42.114430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ac47dab1-71eb-4532-82f4-65d12972c457 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:42.162333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ac47dab1-71eb-4532-82f4-65d12972c457 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:42.169534 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ac47dab1-71eb-4532-82f4-65d12972c457 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1242 microversion: 2.1 time: 0.065353 May 12 14:38:42.171068 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 421/859] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:42 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:42.178392 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-807bd5e4-27d5-47aa-b346-ff140a09e572 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c66f6872-c8ed-4315-a1e9-2f4fb21f982f"}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:42.179738 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-807bd5e4-27d5-47aa-b346-ff140a09e572 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:42.186116 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-807bd5e4-27d5-47aa-b346-ff140a09e572 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:42.187064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-807bd5e4-27d5-47aa-b346-ff140a09e572 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:42.187875 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-807bd5e4-27d5-47aa-b346-ff140a09e572 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:42.188329 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-807bd5e4-27d5-47aa-b346-ff140a09e572 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:42.387336 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-882ff177-5c76-48bc-9825-b783b925b2a7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:42.388352 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-882ff177-5c76-48bc-9825-b783b925b2a7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:42.396999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-882ff177-5c76-48bc-9825-b783b925b2a7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:42.397729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-882ff177-5c76-48bc-9825-b783b925b2a7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:42.398734 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-882ff177-5c76-48bc-9825-b783b925b2a7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:42.399315 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-882ff177-5c76-48bc-9825-b783b925b2a7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:42.559269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-882ff177-5c76-48bc-9825-b783b925b2a7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:42.569829 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-882ff177-5c76-48bc-9825-b783b925b2a7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1358 microversion: 2.1 time: 0.188414 May 12 14:38:42.572770 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 422/860] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:42 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:42.731331 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-807bd5e4-27d5-47aa-b346-ff140a09e572 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "POST /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.687857 May 12 14:38:42.731891 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 439/861] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 12 14:38:42 2022] POST /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-volume_attachments => generated 194 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:42.944125 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-eb17943e-5c7d-4054-96f0-655d59c56e50 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:42.944780 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-eb17943e-5c7d-4054-96f0-655d59c56e50 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:42.950597 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb17943e-5c7d-4054-96f0-655d59c56e50 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:42.951083 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb17943e-5c7d-4054-96f0-655d59c56e50 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:42.952411 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb17943e-5c7d-4054-96f0-655d59c56e50 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:42.952858 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb17943e-5c7d-4054-96f0-655d59c56e50 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.124006 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ed080e03-37ac-4104-ba0b-95b26e4c2a98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:43.125056 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ed080e03-37ac-4104-ba0b-95b26e4c2a98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:43.133297 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ed080e03-37ac-4104-ba0b-95b26e4c2a98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.133833 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ed080e03-37ac-4104-ba0b-95b26e4c2a98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.134684 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ed080e03-37ac-4104-ba0b-95b26e4c2a98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.135227 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ed080e03-37ac-4104-ba0b-95b26e4c2a98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.153448 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-eb17943e-5c7d-4054-96f0-655d59c56e50 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:43.174152 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-eb17943e-5c7d-4054-96f0-655d59c56e50 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1265 microversion: 2.1 time: 0.233793 May 12 14:38:43.176058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 423/862] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:42 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:43.190252 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0edeb037-2d36-4e50-a8ba-040e40909575 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:43.191139 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0edeb037-2d36-4e50-a8ba-040e40909575 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:43.198029 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0edeb037-2d36-4e50-a8ba-040e40909575 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.198566 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0edeb037-2d36-4e50-a8ba-040e40909575 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.199446 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0edeb037-2d36-4e50-a8ba-040e40909575 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.199971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0edeb037-2d36-4e50-a8ba-040e40909575 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.252819 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ed080e03-37ac-4104-ba0b-95b26e4c2a98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:43.261676 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ed080e03-37ac-4104-ba0b-95b26e4c2a98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:43.269075 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ed080e03-37ac-4104-ba0b-95b26e4c2a98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:43.270764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ed080e03-37ac-4104-ba0b-95b26e4c2a98 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1655 microversion: 2.20 time: 0.152783 May 12 14:38:43.284634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 440/863] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:38:43 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1655 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:38:43.318690 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0edeb037-2d36-4e50-a8ba-040e40909575 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:43.327231 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0edeb037-2d36-4e50-a8ba-040e40909575 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1294 microversion: 2.1 time: 0.140767 May 12 14:38:43.328074 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 424/864] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:43 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1294 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:43.573239 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-cc2b0a27-08ed-4ef7-9457-d081bc25f4fe req-b948b119-fe7d-4f27-a5a9-28899ad07d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e2a4c2-6255-4074-9a3c-e5159c3f7b87", "name": "network-vif-deleted", "tag": "7fccb52d-a09a-4e64-adbe-8b42348d39c5"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:43.582400 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-cc2b0a27-08ed-4ef7-9457-d081bc25f4fe req-b948b119-fe7d-4f27-a5a9-28899ad07d33 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.582855 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-cc2b0a27-08ed-4ef7-9457-d081bc25f4fe req-b948b119-fe7d-4f27-a5a9-28899ad07d33 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.591077 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-54739cab-50ec-4ab2-8c19-095843adcfa1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:43.591783 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-54739cab-50ec-4ab2-8c19-095843adcfa1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:43.597226 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-cc2b0a27-08ed-4ef7-9457-d081bc25f4fe req-b948b119-fe7d-4f27-a5a9-28899ad07d33 service nova] Creating event network-vif-deleted:7fccb52d-a09a-4e64-adbe-8b42348d39c5 for instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 on hv-cinder-77703 May 12 14:38:43.597897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-54739cab-50ec-4ab2-8c19-095843adcfa1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.598345 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-54739cab-50ec-4ab2-8c19-095843adcfa1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.599449 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-54739cab-50ec-4ab2-8c19-095843adcfa1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.599754 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-54739cab-50ec-4ab2-8c19-095843adcfa1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.605253 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-cc2b0a27-08ed-4ef7-9457-d081bc25f4fe req-b948b119-fe7d-4f27-a5a9-28899ad07d33 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035839 May 12 14:38:43.606517 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 441/865] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:43.743586 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-54739cab-50ec-4ab2-8c19-095843adcfa1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:43.753307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-54739cab-50ec-4ab2-8c19-095843adcfa1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1547 microversion: 2.1 time: 0.167969 May 12 14:38:43.755074 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 425/866] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:43 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1547 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:43.770380 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4397a979-1fe2-4570-8df4-15dbfef2c2e2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:43.771196 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4397a979-1fe2-4570-8df4-15dbfef2c2e2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:43.777502 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4397a979-1fe2-4570-8df4-15dbfef2c2e2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.777895 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4397a979-1fe2-4570-8df4-15dbfef2c2e2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.778667 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4397a979-1fe2-4570-8df4-15dbfef2c2e2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.779136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4397a979-1fe2-4570-8df4-15dbfef2c2e2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.914243 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4397a979-1fe2-4570-8df4-15dbfef2c2e2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:43.922448 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4397a979-1fe2-4570-8df4-15dbfef2c2e2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1547 microversion: 2.1 time: 0.156229 May 12 14:38:43.923042 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 442/867] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:43 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:43.938223 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-17732c14-4b83-467d-82ab-6b1c0322e819 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:43.941767 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-17732c14-4b83-467d-82ab-6b1c0322e819 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:43.942537 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-17732c14-4b83-467d-82ab-6b1c0322e819 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Searching by: {'deleted': False, 'project_id': '9462307fa603476baafa1c5c8ae491d5'} {{(pid=118216) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 12 14:38:43.948996 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-17732c14-4b83-467d-82ab-6b1c0322e819 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.949449 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-17732c14-4b83-467d-82ab-6b1c0322e819 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:43.950260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-17732c14-4b83-467d-82ab-6b1c0322e819 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:43.950701 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-17732c14-4b83-467d-82ab-6b1c0322e819 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:44.040874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.multi_cell_list [None req-17732c14-4b83-467d-82ab-6b1c0322e819 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118216) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 12 14:38:44.139645 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-17732c14-4b83-467d-82ab-6b1c0322e819 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204917 May 12 14:38:44.140453 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 426/868] 10.222.0.75 () {58 vars in 1124 bytes} [Thu May 12 14:38:43 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:38:44.152867 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f04198f6-d207-43f8-8c66-a2d64429d2a2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:44.155063 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f04198f6-d207-43f8-8c66-a2d64429d2a2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:44.162395 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f04198f6-d207-43f8-8c66-a2d64429d2a2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:44.162921 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f04198f6-d207-43f8-8c66-a2d64429d2a2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:44.163912 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f04198f6-d207-43f8-8c66-a2d64429d2a2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:44.164353 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f04198f6-d207-43f8-8c66-a2d64429d2a2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:44.195104 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-27234dd5-a019-4cca-9d0f-cfb7b9d75cba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:44.196626 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-27234dd5-a019-4cca-9d0f-cfb7b9d75cba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:44.205688 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-27234dd5-a019-4cca-9d0f-cfb7b9d75cba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:44.206392 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-27234dd5-a019-4cca-9d0f-cfb7b9d75cba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:44.207532 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-27234dd5-a019-4cca-9d0f-cfb7b9d75cba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:44.208393 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-27234dd5-a019-4cca-9d0f-cfb7b9d75cba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:44.750619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f04198f6-d207-43f8-8c66-a2d64429d2a2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:44.758362 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f04198f6-d207-43f8-8c66-a2d64429d2a2 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1547 microversion: 2.1 time: 0.610009 May 12 14:38:44.769698 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 443/869] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:44 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1547 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:44.775226 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5bd2eb1d-c2ba-4e7b-8aa7-92064f25f071 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:44.776634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5bd2eb1d-c2ba-4e7b-8aa7-92064f25f071 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:44.783844 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5bd2eb1d-c2ba-4e7b-8aa7-92064f25f071 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:44.784310 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5bd2eb1d-c2ba-4e7b-8aa7-92064f25f071 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:44.785204 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5bd2eb1d-c2ba-4e7b-8aa7-92064f25f071 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:44.785652 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5bd2eb1d-c2ba-4e7b-8aa7-92064f25f071 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:44.795993 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-27234dd5-a019-4cca-9d0f-cfb7b9d75cba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:44.807073 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-27234dd5-a019-4cca-9d0f-cfb7b9d75cba tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1265 microversion: 2.1 time: 0.617969 May 12 14:38:44.808191 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 427/870] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:44 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1265 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:44.815012 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-160da916-1bed-4bfc-b5c9-3854568d71af tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:44.817213 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-160da916-1bed-4bfc-b5c9-3854568d71af tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:44.822391 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5bd2eb1d-c2ba-4e7b-8aa7-92064f25f071 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:44.823101 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5bd2eb1d-c2ba-4e7b-8aa7-92064f25f071 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:44.823914 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-5bd2eb1d-c2ba-4e7b-8aa7-92064f25f071 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lazy-loading 'fault' on Instance uuid d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:38:44.824336 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-160da916-1bed-4bfc-b5c9-3854568d71af tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:44.824940 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-160da916-1bed-4bfc-b5c9-3854568d71af tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:44.825923 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-160da916-1bed-4bfc-b5c9-3854568d71af tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:44.828146 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-160da916-1bed-4bfc-b5c9-3854568d71af tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:44.874787 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5bd2eb1d-c2ba-4e7b-8aa7-92064f25f071 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:44.891660 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5bd2eb1d-c2ba-4e7b-8aa7-92064f25f071 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:44.893190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5bd2eb1d-c2ba-4e7b-8aa7-92064f25f071 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:44.894443 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5bd2eb1d-c2ba-4e7b-8aa7-92064f25f071 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 200 len: 1370 microversion: 2.20 time: 0.134092 May 12 14:38:44.895022 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 444/871] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:38:44 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 1370 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:44.905595 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-160da916-1bed-4bfc-b5c9-3854568d71af tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:44.924830 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-8758c41d-27da-4f63-87c0-7a2952e1da19 req-dd825be9-ce73-43db-ab6d-25407960c67b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45819a2-89a0-494b-bdbc-650fcfddd2cd", "name": "network-vif-plugged", "status": "completed", "tag": "10ba03ca-52fe-42dc-a95e-573a96e2bd48"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:44.927583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-160da916-1bed-4bfc-b5c9-3854568d71af tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1300 microversion: 2.1 time: 0.118130 May 12 14:38:44.930359 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 428/872] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:44 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1300 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:44.947648 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-8758c41d-27da-4f63-87c0-7a2952e1da19 req-dd825be9-ce73-43db-ab6d-25407960c67b service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:44.948100 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-8758c41d-27da-4f63-87c0-7a2952e1da19 req-dd825be9-ce73-43db-ab6d-25407960c67b service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:44.962787 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-8758c41d-27da-4f63-87c0-7a2952e1da19 req-dd825be9-ce73-43db-ab6d-25407960c67b service nova] Creating event network-vif-plugged:10ba03ca-52fe-42dc-a95e-573a96e2bd48 for instance c45819a2-89a0-494b-bdbc-650fcfddd2cd on hv-cinder-77703 May 12 14:38:44.969025 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-8758c41d-27da-4f63-87c0-7a2952e1da19 req-dd825be9-ce73-43db-ab6d-25407960c67b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054196 May 12 14:38:44.969984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 445/873] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:45.824335 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a0fcc588-468b-4193-9f7f-f6b8e9ede281 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:45.824946 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a0fcc588-468b-4193-9f7f-f6b8e9ede281 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:45.831775 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a0fcc588-468b-4193-9f7f-f6b8e9ede281 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:45.832221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a0fcc588-468b-4193-9f7f-f6b8e9ede281 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:45.832985 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a0fcc588-468b-4193-9f7f-f6b8e9ede281 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:45.833423 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a0fcc588-468b-4193-9f7f-f6b8e9ede281 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:45.914076 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e55363fe-0cd9-4a36-829e-6dbce3fa75e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:45.914868 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e55363fe-0cd9-4a36-829e-6dbce3fa75e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:45.921098 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e55363fe-0cd9-4a36-829e-6dbce3fa75e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:45.921631 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e55363fe-0cd9-4a36-829e-6dbce3fa75e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:45.922804 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e55363fe-0cd9-4a36-829e-6dbce3fa75e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:45.923479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e55363fe-0cd9-4a36-829e-6dbce3fa75e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:45.939403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-e55363fe-0cd9-4a36-829e-6dbce3fa75e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] HTTP exception thrown: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e55363fe-0cd9-4a36-829e-6dbce3fa75e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Request method failure captured: May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 HTTP/1.1 May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRo-uJp52z69PBIo-4zHUdWF7-t-Ab26V5UjIPerI3OAHZhwILOp0LVDyRxgAqZEoaM_UIcwxBLAHR1bbULQUwZUINd52e34RDt87Frpc1A9LEqHtmRg0wW5_ct0GIROhbfPDVxbsdWhdyr07Es5UjF8qwi30yr63vAVMEbCRh2SBZg May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Openstack-Nova-Api-Version: 2.20 May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 202791457f0749649e8cc096f6e43404 May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:38:45.941343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:38:45.943053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/202791457f0749649e8cc096f6e43404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/202791457f0749649e8cc096f6e43404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_202791457f0749649e8cc096f6e43404", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/202791457f0749649e8cc096f6e43404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:38:45.943053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:38:45.943053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 202791457f0749649e8cc096f6e43404 May 12 14:38:45.943053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:38:45.943053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-AttachVolumeShelveTestJSON-2013624373-project May 12 14:38:45.943053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:38:45.943053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:38:45.943053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: c3b76edcb338405a9bf2f68e91dfacdd May 12 14:38:45.943053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2013624373-project May 12 14:38:45.943053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:38:45.943053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. May 12 14:38:45.943053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': 'd0e2a4c2-6255-4074-9a3c-e5159c3f7b87'} May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:38:45.943972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. May 12 14:38:45.945508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:38:45.946831 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e55363fe-0cd9-4a36-829e-6dbce3fa75e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Returning 404 to user: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:38:45.946831 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e55363fe-0cd9-4a36-829e-6dbce3fa75e1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 404 len: 111 microversion: 2.20 time: 0.033674 May 12 14:38:45.947185 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 446/874] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:38:45 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:38:45.952587 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-650cac69-42db-4650-80fb-37f4aed0e2a8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:45.953365 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-650cac69-42db-4650-80fb-37f4aed0e2a8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:45.963809 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-650cac69-42db-4650-80fb-37f4aed0e2a8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:45.964616 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-650cac69-42db-4650-80fb-37f4aed0e2a8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:45.968020 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-650cac69-42db-4650-80fb-37f4aed0e2a8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:45.969356 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-650cac69-42db-4650-80fb-37f4aed0e2a8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:46.113202 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a0fcc588-468b-4193-9f7f-f6b8e9ede281 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:46.120707 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a0fcc588-468b-4193-9f7f-f6b8e9ede281 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1265 microversion: 2.1 time: 0.299992 May 12 14:38:46.121638 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 429/875] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:45 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:46.134373 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6f1ddcb3-6026-43ea-bc54-172a3231d71c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '.version_select at 0x7f5b260a1c10>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:46.152242 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6f1ddcb3-6026-43ea-bc54-172a3231d71c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-586766621" status: 204 len: 0 microversion: 2.20 time: 0.021476 May 12 14:38:46.153310 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 430/876] 10.222.0.75 () {60 vars in 1258 bytes} [Thu May 12 14:38:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-586766621 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 14:38:46.246907 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-650cac69-42db-4650-80fb-37f4aed0e2a8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:46.256802 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-650cac69-42db-4650-80fb-37f4aed0e2a8 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1367 microversion: 2.1 time: 0.308309 May 12 14:38:46.257615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 447/877] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:45 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:46.419458 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-34dd58f8-725c-48ed-a5b3-ca865034a4b1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2241aed-a978-49a1-a8d0-a0883e28fe13"}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:46.420560 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-34dd58f8-725c-48ed-a5b3-ca865034a4b1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:46.426715 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34dd58f8-725c-48ed-a5b3-ca865034a4b1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:46.427591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34dd58f8-725c-48ed-a5b3-ca865034a4b1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:46.428231 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34dd58f8-725c-48ed-a5b3-ca865034a4b1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:46.428658 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-34dd58f8-725c-48ed-a5b3-ca865034a4b1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:46.775521 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-8c83b1f2-c8fb-4a31-881a-2c2bc465b1bd req-b9fd285f-afe1-4ae0-8967-bf346f0962ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134a856e-1321-471c-bc31-43307ca41802", "tag": "16daad85-8ecb-4b6e-94ba-93e5f3dce471"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:46.796923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-8c83b1f2-c8fb-4a31-881a-2c2bc465b1bd req-b9fd285f-afe1-4ae0-8967-bf346f0962ed service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:46.797753 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-8c83b1f2-c8fb-4a31-881a-2c2bc465b1bd req-b9fd285f-afe1-4ae0-8967-bf346f0962ed service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:46.812063 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-8c83b1f2-c8fb-4a31-881a-2c2bc465b1bd req-b9fd285f-afe1-4ae0-8967-bf346f0962ed service nova] Creating event network-changed:16daad85-8ecb-4b6e-94ba-93e5f3dce471 for instance 134a856e-1321-471c-bc31-43307ca41802 on hv-cinder-77703 May 12 14:38:46.818905 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-8c83b1f2-c8fb-4a31-881a-2c2bc465b1bd req-b9fd285f-afe1-4ae0-8967-bf346f0962ed service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054868 May 12 14:38:46.820385 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 448/878] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:38:46.824209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-34dd58f8-725c-48ed-a5b3-ca865034a4b1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "POST /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408201 May 12 14:38:46.831073 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 431/879] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 12 14:38:46 2022] POST /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:46.961076 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bd4f4f53-02b4-4ace-823b-185138032208 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Action: 'create', calling method: .version_select at 0x7f5b2689d160>, body: {"keypair": {"name": "tempest-keypair-1646045558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXH+HkJ/6ock0H/rRcFXdaSUAeoIHs6VfS9Pu7CIo7aAQ4nptfp2ghyeCN/hFacAMmuf5rHoCFIs+sIWUVL3c7TnZCJw9UXAbPd5R1klJKuWpXMa3GjksBdWV8RboOvEQ=="}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:46.976991 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-bd4f4f53-02b4-4ace-823b-185138032208 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Getting quotas for project 202791457f0749649e8cc096f6e43404. Resources: {'key_pairs'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:38:46.981777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-bd4f4f53-02b4-4ace-823b-185138032208 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Getting quotas for user c3b76edcb338405a9bf2f68e91dfacdd and project 202791457f0749649e8cc096f6e43404. Resources: {'key_pairs'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:38:47.007987 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bd4f4f53-02b4-4ace-823b-185138032208 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051344 May 12 14:38:47.008755 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 449/880] 10.222.0.75 () {62 vars in 1199 bytes} [Thu May 12 14:38:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 14:38:47.138209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c00b2d6c-eba6-4268-a835-4a7bcee4650b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:47.139655 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c00b2d6c-eba6-4268-a835-4a7bcee4650b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:47.146347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c00b2d6c-eba6-4268-a835-4a7bcee4650b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:47.147062 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c00b2d6c-eba6-4268-a835-4a7bcee4650b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:47.147937 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c00b2d6c-eba6-4268-a835-4a7bcee4650b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:47.148581 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c00b2d6c-eba6-4268-a835-4a7bcee4650b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:47.277006 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9a0903bf-2c95-44fc-97ea-40d0c1e42f62 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:47.278847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9a0903bf-2c95-44fc-97ea-40d0c1e42f62 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:47.289113 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9a0903bf-2c95-44fc-97ea-40d0c1e42f62 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:47.289574 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9a0903bf-2c95-44fc-97ea-40d0c1e42f62 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:47.290372 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9a0903bf-2c95-44fc-97ea-40d0c1e42f62 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:47.290819 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9a0903bf-2c95-44fc-97ea-40d0c1e42f62 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:47.297058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c00b2d6c-eba6-4268-a835-4a7bcee4650b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:47.304799 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c00b2d6c-eba6-4268-a835-4a7bcee4650b tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1453 microversion: 2.1 time: 0.170971 May 12 14:38:47.305453 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 432/881] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:47 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:47.321429 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3dea7314-c7d5-4a2a-aa8c-f95b82de0c44 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:47.322043 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3dea7314-c7d5-4a2a-aa8c-f95b82de0c44 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:47.330950 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3dea7314-c7d5-4a2a-aa8c-f95b82de0c44 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:47.331441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3dea7314-c7d5-4a2a-aa8c-f95b82de0c44 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:47.332235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3dea7314-c7d5-4a2a-aa8c-f95b82de0c44 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:47.332681 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3dea7314-c7d5-4a2a-aa8c-f95b82de0c44 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:47.479607 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9a0903bf-2c95-44fc-97ea-40d0c1e42f62 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:47.488132 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9a0903bf-2c95-44fc-97ea-40d0c1e42f62 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1367 microversion: 2.1 time: 0.218112 May 12 14:38:47.488909 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 450/882] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:47 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:47.509904 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3dea7314-c7d5-4a2a-aa8c-f95b82de0c44 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:47.522681 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3dea7314-c7d5-4a2a-aa8c-f95b82de0c44 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1453 microversion: 2.1 time: 0.204968 May 12 14:38:47.523579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 433/883] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:47 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1453 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:48.378200 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1410693911", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a850f271-3b32-48bf-8bb5-be1eb540a3d0"}], "security_groups": [{"name": "tempest-securitygroup--407705470"}], "key_name": "tempest-keypair-1646045558", "user_data": "}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:48.505376 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-61632b5e-6757-4e7e-8552-0788506b675a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:48.506100 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-61632b5e-6757-4e7e-8552-0788506b675a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:48.512446 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-61632b5e-6757-4e7e-8552-0788506b675a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:48.512973 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-61632b5e-6757-4e7e-8552-0788506b675a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:48.514556 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-61632b5e-6757-4e7e-8552-0788506b675a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:48.515190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-61632b5e-6757-4e7e-8552-0788506b675a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:48.550312 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.network.neutron [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] validate_networks() for [('a850f271-3b32-48bf-8bb5-be1eb540a3d0', None, None, None, None, None)] {{(pid=118217) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:38:48.802837 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-61632b5e-6757-4e7e-8552-0788506b675a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:48.810126 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-61632b5e-6757-4e7e-8552-0788506b675a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1367 microversion: 2.1 time: 0.308595 May 12 14:38:48.811352 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 434/884] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:48 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:49.241018 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Flavor limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:38:49.241639 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Image limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:38:49.242121 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Flavor pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:38:49.242536 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Image pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:38:49.242957 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:38:49.252596 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:49.253047 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:49.253887 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:49.254332 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:49.271232 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Getting quotas for project 202791457f0749649e8cc096f6e43404. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:38:49.275192 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Getting quotas for user c3b76edcb338405a9bf2f68e91dfacdd and project 202791457f0749649e8cc096f6e43404. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:38:49.286197 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Going to run 1 instances... {{(pid=118217) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:38:49.288507 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:38:49.337996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-026fb352-46ab-4241-8d6e-999ab9634ee8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.964053 May 12 14:38:49.338884 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 451/885] 10.222.0.75 () {62 vars in 1187 bytes} [Thu May 12 14:38:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 14:38:49.349151 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8c793aa0-f57b-4597-b7ba-e681856b5b22 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:49.350086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-8c793aa0-f57b-4597-b7ba-e681856b5b22 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:49.698963 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8c793aa0-f57b-4597-b7ba-e681856b5b22 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:49.706507 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8c793aa0-f57b-4597-b7ba-e681856b5b22 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:49.708162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8c793aa0-f57b-4597-b7ba-e681856b5b22 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:49.709351 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8c793aa0-f57b-4597-b7ba-e681856b5b22 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1282 microversion: 2.20 time: 0.364113 May 12 14:38:49.710001 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 435/886] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:38:49 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1282 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:38:49.828251 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-621552ee-f4e8-47fd-87ac-b4b715490522 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:49.828877 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-621552ee-f4e8-47fd-87ac-b4b715490522 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:49.835506 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-621552ee-f4e8-47fd-87ac-b4b715490522 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:49.835967 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-621552ee-f4e8-47fd-87ac-b4b715490522 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:49.836749 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-621552ee-f4e8-47fd-87ac-b4b715490522 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:49.837195 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-621552ee-f4e8-47fd-87ac-b4b715490522 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:50.038791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-621552ee-f4e8-47fd-87ac-b4b715490522 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:50.046965 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-621552ee-f4e8-47fd-87ac-b4b715490522 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1367 microversion: 2.1 time: 0.223023 May 12 14:38:50.048165 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 452/887] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:49 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:50.159582 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-ba9ef1d0-583f-4b45-a4f2-a04b6ca0f0b7 req-a3132864-46dc-429e-a1f7-c0bc4fb751e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c45819a2-89a0-494b-bdbc-650fcfddd2cd", "tag": "10ba03ca-52fe-42dc-a95e-573a96e2bd48"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:50.169672 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-ba9ef1d0-583f-4b45-a4f2-a04b6ca0f0b7 req-a3132864-46dc-429e-a1f7-c0bc4fb751e9 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:50.170864 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-ba9ef1d0-583f-4b45-a4f2-a04b6ca0f0b7 req-a3132864-46dc-429e-a1f7-c0bc4fb751e9 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:50.182466 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-ba9ef1d0-583f-4b45-a4f2-a04b6ca0f0b7 req-a3132864-46dc-429e-a1f7-c0bc4fb751e9 service nova] Creating event network-changed:10ba03ca-52fe-42dc-a95e-573a96e2bd48 for instance c45819a2-89a0-494b-bdbc-650fcfddd2cd on hv-cinder-77703 May 12 14:38:50.188308 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-ba9ef1d0-583f-4b45-a4f2-a04b6ca0f0b7 req-a3132864-46dc-429e-a1f7-c0bc4fb751e9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032323 May 12 14:38:50.189283 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 436/888] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:50.728013 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2fc2746d-2ffa-4600-ab04-33b17b75a060 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:50.728679 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2fc2746d-2ffa-4600-ab04-33b17b75a060 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:50.735464 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2fc2746d-2ffa-4600-ab04-33b17b75a060 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:50.735923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2fc2746d-2ffa-4600-ab04-33b17b75a060 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:50.736927 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2fc2746d-2ffa-4600-ab04-33b17b75a060 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:50.737381 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2fc2746d-2ffa-4600-ab04-33b17b75a060 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:50.798525 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2fc2746d-2ffa-4600-ab04-33b17b75a060 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:50.806298 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2fc2746d-2ffa-4600-ab04-33b17b75a060 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:50.807833 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2fc2746d-2ffa-4600-ab04-33b17b75a060 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:50.808924 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2fc2746d-2ffa-4600-ab04-33b17b75a060 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1286 microversion: 2.20 time: 0.085211 May 12 14:38:50.809488 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 453/889] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:38:50 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:51.065261 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7a688c61-92a3-4a61-85af-05f8961c0fb7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:51.066111 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7a688c61-92a3-4a61-85af-05f8961c0fb7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:51.074264 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7a688c61-92a3-4a61-85af-05f8961c0fb7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:51.074721 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7a688c61-92a3-4a61-85af-05f8961c0fb7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:51.076247 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7a688c61-92a3-4a61-85af-05f8961c0fb7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:51.076900 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7a688c61-92a3-4a61-85af-05f8961c0fb7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:51.284136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7a688c61-92a3-4a61-85af-05f8961c0fb7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:51.292944 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7a688c61-92a3-4a61-85af-05f8961c0fb7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1367 microversion: 2.1 time: 0.232539 May 12 14:38:51.293609 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 437/890] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:51 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:51.825710 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8b95833f-0551-43e2-a957-e28c7104215d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:51.826842 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8b95833f-0551-43e2-a957-e28c7104215d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:51.833179 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b95833f-0551-43e2-a957-e28c7104215d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:51.833637 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b95833f-0551-43e2-a957-e28c7104215d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:51.834410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b95833f-0551-43e2-a957-e28c7104215d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:51.834853 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b95833f-0551-43e2-a957-e28c7104215d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:51.896388 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8b95833f-0551-43e2-a957-e28c7104215d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:51.904647 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8b95833f-0551-43e2-a957-e28c7104215d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:51.906330 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8b95833f-0551-43e2-a957-e28c7104215d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:51.907559 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8b95833f-0551-43e2-a957-e28c7104215d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1278 microversion: 2.20 time: 0.085811 May 12 14:38:51.908120 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 454/891] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:38:51 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:52.309965 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9023c94d-8f26-4e0b-bf57-2b983d3b7591 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:52.311252 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9023c94d-8f26-4e0b-bf57-2b983d3b7591 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:52.317631 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9023c94d-8f26-4e0b-bf57-2b983d3b7591 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:52.318041 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9023c94d-8f26-4e0b-bf57-2b983d3b7591 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:52.318817 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9023c94d-8f26-4e0b-bf57-2b983d3b7591 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:52.319287 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9023c94d-8f26-4e0b-bf57-2b983d3b7591 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:52.416919 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d89f5518-5473-4e99-af38-93300d741801 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:52.417937 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d89f5518-5473-4e99-af38-93300d741801 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:52.424441 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d89f5518-5473-4e99-af38-93300d741801 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:52.424898 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d89f5518-5473-4e99-af38-93300d741801 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:52.425685 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d89f5518-5473-4e99-af38-93300d741801 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:52.426129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d89f5518-5473-4e99-af38-93300d741801 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:52.448327 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-d89f5518-5473-4e99-af38-93300d741801 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lazy-loading 'flavor' on Instance uuid 26e40740-6dab-4657-abc3-eb83ee4b4c4d {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:38:52.453969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9023c94d-8f26-4e0b-bf57-2b983d3b7591 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:52.461304 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9023c94d-8f26-4e0b-bf57-2b983d3b7591 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1367 microversion: 2.1 time: 0.155596 May 12 14:38:52.461964 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 438/892] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:52 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:52.573129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d89f5518-5473-4e99-af38-93300d741801 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "POST /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/action" status: 200 len: 32 microversion: 2.1 time: 0.160378 May 12 14:38:52.573928 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 455/893] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 12 14:38:52 2022] POST /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 12 14:38:52.583758 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-aade23c2-3ae2-46c9-99b8-a5c7f897c161 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:52.584489 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-aade23c2-3ae2-46c9-99b8-a5c7f897c161 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:52.590353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-aade23c2-3ae2-46c9-99b8-a5c7f897c161 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:52.590815 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-aade23c2-3ae2-46c9-99b8-a5c7f897c161 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:52.591668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-aade23c2-3ae2-46c9-99b8-a5c7f897c161 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:52.592649 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-aade23c2-3ae2-46c9-99b8-a5c7f897c161 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:52.926164 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-cabc7b1d-2d6f-4172-8b2e-40e0170ebf44 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:52.926867 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-cabc7b1d-2d6f-4172-8b2e-40e0170ebf44 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:52.933390 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cabc7b1d-2d6f-4172-8b2e-40e0170ebf44 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:52.933849 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cabc7b1d-2d6f-4172-8b2e-40e0170ebf44 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:52.934715 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cabc7b1d-2d6f-4172-8b2e-40e0170ebf44 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:52.936098 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cabc7b1d-2d6f-4172-8b2e-40e0170ebf44 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:52.967873 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-aade23c2-3ae2-46c9-99b8-a5c7f897c161 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:52.977750 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-aade23c2-3ae2-46c9-99b8-a5c7f897c161 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.397746 May 12 14:38:52.978617 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 439/894] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:52 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:53.093955 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-cabc7b1d-2d6f-4172-8b2e-40e0170ebf44 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:53.101834 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-cabc7b1d-2d6f-4172-8b2e-40e0170ebf44 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:53.103491 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-cabc7b1d-2d6f-4172-8b2e-40e0170ebf44 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:53.104686 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-cabc7b1d-2d6f-4172-8b2e-40e0170ebf44 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1340 microversion: 2.20 time: 0.182827 May 12 14:38:53.105336 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 456/895] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:38:52 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1340 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:38:53.478642 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6c572481-482b-4035-9a5e-4230d31b911f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:53.479374 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6c572481-482b-4035-9a5e-4230d31b911f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:53.488494 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c572481-482b-4035-9a5e-4230d31b911f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:53.489221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c572481-482b-4035-9a5e-4230d31b911f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:53.490225 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c572481-482b-4035-9a5e-4230d31b911f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:53.490673 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c572481-482b-4035-9a5e-4230d31b911f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:53.929933 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6c572481-482b-4035-9a5e-4230d31b911f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:53.937245 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6c572481-482b-4035-9a5e-4230d31b911f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1367 microversion: 2.1 time: 0.462692 May 12 14:38:53.938015 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 440/896] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:53 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1367 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:53.996010 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-030a0691-799f-4130-ab6b-fe87e2101010 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:53.996659 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-030a0691-799f-4130-ab6b-fe87e2101010 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:54.003260 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-030a0691-799f-4130-ab6b-fe87e2101010 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:54.003791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-030a0691-799f-4130-ab6b-fe87e2101010 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:54.004702 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-030a0691-799f-4130-ab6b-fe87e2101010 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:54.005232 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-030a0691-799f-4130-ab6b-fe87e2101010 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:54.122758 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a8ed3d59-3851-4274-aad2-3019d1526705 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:54.123427 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a8ed3d59-3851-4274-aad2-3019d1526705 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:54.129350 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a8ed3d59-3851-4274-aad2-3019d1526705 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:54.129803 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a8ed3d59-3851-4274-aad2-3019d1526705 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:54.130576 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a8ed3d59-3851-4274-aad2-3019d1526705 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:54.131016 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a8ed3d59-3851-4274-aad2-3019d1526705 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:54.232318 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a8ed3d59-3851-4274-aad2-3019d1526705 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:54.240902 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a8ed3d59-3851-4274-aad2-3019d1526705 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:54.242553 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a8ed3d59-3851-4274-aad2-3019d1526705 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:54.243739 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a8ed3d59-3851-4274-aad2-3019d1526705 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1340 microversion: 2.20 time: 0.125119 May 12 14:38:54.244524 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 441/897] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:38:54 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1340 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:38:54.291351 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-030a0691-799f-4130-ab6b-fe87e2101010 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:54.308770 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-030a0691-799f-4130-ab6b-fe87e2101010 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.316783 May 12 14:38:54.309619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 457/898] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:53 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:54.956441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a1b0887b-8105-4678-83d0-e1f94889f33f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:54.957069 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a1b0887b-8105-4678-83d0-e1f94889f33f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:54.964062 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a1b0887b-8105-4678-83d0-e1f94889f33f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:54.964770 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a1b0887b-8105-4678-83d0-e1f94889f33f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:54.965877 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a1b0887b-8105-4678-83d0-e1f94889f33f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:54.966479 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a1b0887b-8105-4678-83d0-e1f94889f33f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:54.969954 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-e93092b4-1e6a-44ec-ace8-34b82767954f req-e8e5729b-4aa4-4129-8df5-09ca37a0654f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134a856e-1321-471c-bc31-43307ca41802", "name": "network-vif-plugged", "status": "completed", "tag": "16daad85-8ecb-4b6e-94ba-93e5f3dce471"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:54.987091 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-e93092b4-1e6a-44ec-ace8-34b82767954f req-e8e5729b-4aa4-4129-8df5-09ca37a0654f service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:54.988000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-e93092b4-1e6a-44ec-ace8-34b82767954f req-e8e5729b-4aa4-4129-8df5-09ca37a0654f service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:55.004321 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-e93092b4-1e6a-44ec-ace8-34b82767954f req-e8e5729b-4aa4-4129-8df5-09ca37a0654f service nova] Creating event network-vif-plugged:16daad85-8ecb-4b6e-94ba-93e5f3dce471 for instance 134a856e-1321-471c-bc31-43307ca41802 on hv-cinder-77703 May 12 14:38:55.012297 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-e93092b4-1e6a-44ec-ace8-34b82767954f req-e8e5729b-4aa4-4129-8df5-09ca37a0654f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056179 May 12 14:38:55.014237 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 458/899] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:55.213704 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a1b0887b-8105-4678-83d0-e1f94889f33f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:55.223727 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a1b0887b-8105-4678-83d0-e1f94889f33f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1367 microversion: 2.1 time: 0.271957 May 12 14:38:55.224777 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 442/900] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:54 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:55.264603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-fbfae1ea-b5d3-4bf7-90ec-39ca54636dda tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:55.265304 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-fbfae1ea-b5d3-4bf7-90ec-39ca54636dda tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:55.271561 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fbfae1ea-b5d3-4bf7-90ec-39ca54636dda tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:55.272010 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fbfae1ea-b5d3-4bf7-90ec-39ca54636dda tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:55.272786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fbfae1ea-b5d3-4bf7-90ec-39ca54636dda tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:55.273419 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fbfae1ea-b5d3-4bf7-90ec-39ca54636dda tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:55.326589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a03fab30-4a36-4f45-a7a3-c4be6fefd6b8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:55.327241 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a03fab30-4a36-4f45-a7a3-c4be6fefd6b8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:55.333448 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a03fab30-4a36-4f45-a7a3-c4be6fefd6b8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:55.333908 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a03fab30-4a36-4f45-a7a3-c4be6fefd6b8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:55.334696 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a03fab30-4a36-4f45-a7a3-c4be6fefd6b8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:55.335193 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a03fab30-4a36-4f45-a7a3-c4be6fefd6b8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:55.563267 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-fbfae1ea-b5d3-4bf7-90ec-39ca54636dda tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:55.571051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-fbfae1ea-b5d3-4bf7-90ec-39ca54636dda tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:55.572567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-fbfae1ea-b5d3-4bf7-90ec-39ca54636dda tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:55.573684 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-fbfae1ea-b5d3-4bf7-90ec-39ca54636dda tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1407 microversion: 2.20 time: 0.313723 May 12 14:38:55.574262 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 459/901] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:38:55 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:55.624261 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-2aa5be8a-b44a-43f3-81b6-9074b66fbd26 req-cd334417-bb8a-4ff2-8833-9b18e8f82a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "533a547e-b44f-4a33-8725-24b323556322", "tag": "152a3c94-4ce4-4682-a2c1-1ad44f9d899e"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:55.630741 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a03fab30-4a36-4f45-a7a3-c4be6fefd6b8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:55.640942 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a03fab30-4a36-4f45-a7a3-c4be6fefd6b8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.318347 May 12 14:38:55.642446 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 443/902] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:55 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:55.644093 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-2aa5be8a-b44a-43f3-81b6-9074b66fbd26 req-cd334417-bb8a-4ff2-8833-9b18e8f82a2b service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:55.644783 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-2aa5be8a-b44a-43f3-81b6-9074b66fbd26 req-cd334417-bb8a-4ff2-8833-9b18e8f82a2b service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:55.667004 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-2aa5be8a-b44a-43f3-81b6-9074b66fbd26 req-cd334417-bb8a-4ff2-8833-9b18e8f82a2b service nova] Creating event network-changed:152a3c94-4ce4-4682-a2c1-1ad44f9d899e for instance 533a547e-b44f-4a33-8725-24b323556322 on hv-cinder-77703 May 12 14:38:55.673026 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-2aa5be8a-b44a-43f3-81b6-9074b66fbd26 req-cd334417-bb8a-4ff2-8833-9b18e8f82a2b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054577 May 12 14:38:55.673835 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 460/903] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:38:56.241473 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-72e0aa90-89f6-4719-a6cd-35d19885a8b3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:56.242094 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-72e0aa90-89f6-4719-a6cd-35d19885a8b3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:56.248796 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-72e0aa90-89f6-4719-a6cd-35d19885a8b3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:56.249284 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-72e0aa90-89f6-4719-a6cd-35d19885a8b3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:56.250062 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-72e0aa90-89f6-4719-a6cd-35d19885a8b3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:56.250503 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-72e0aa90-89f6-4719-a6cd-35d19885a8b3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:56.384175 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-72e0aa90-89f6-4719-a6cd-35d19885a8b3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:56.391982 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-72e0aa90-89f6-4719-a6cd-35d19885a8b3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1367 microversion: 2.1 time: 0.154386 May 12 14:38:56.392503 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 444/904] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:56 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:56.592754 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0a71b9c3-0af5-4bc5-9454-739b2b58bfcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:56.593463 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0a71b9c3-0af5-4bc5-9454-739b2b58bfcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:56.599574 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0a71b9c3-0af5-4bc5-9454-739b2b58bfcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:56.600031 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0a71b9c3-0af5-4bc5-9454-739b2b58bfcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:56.600801 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0a71b9c3-0af5-4bc5-9454-739b2b58bfcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:56.601245 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0a71b9c3-0af5-4bc5-9454-739b2b58bfcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:56.658310 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d44e34bf-2bfc-4810-a8ae-765e1c2da212 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:56.658837 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d44e34bf-2bfc-4810-a8ae-765e1c2da212 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:56.664758 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d44e34bf-2bfc-4810-a8ae-765e1c2da212 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:56.665206 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d44e34bf-2bfc-4810-a8ae-765e1c2da212 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:56.665976 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d44e34bf-2bfc-4810-a8ae-765e1c2da212 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:56.666409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d44e34bf-2bfc-4810-a8ae-765e1c2da212 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:56.771401 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0a71b9c3-0af5-4bc5-9454-739b2b58bfcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:56.779216 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0a71b9c3-0af5-4bc5-9454-739b2b58bfcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:56.780736 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0a71b9c3-0af5-4bc5-9454-739b2b58bfcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:56.781852 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0a71b9c3-0af5-4bc5-9454-739b2b58bfcb tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1407 microversion: 2.20 time: 0.194535 May 12 14:38:56.782450 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 461/905] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:38:56 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:56.831701 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d44e34bf-2bfc-4810-a8ae-765e1c2da212 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:56.839593 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d44e34bf-2bfc-4810-a8ae-765e1c2da212 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.185814 May 12 14:38:56.840246 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 445/906] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:56 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:57.408324 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-44cfe5c8-7687-4cc1-b480-6cc39d9c2b66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:57.408940 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-44cfe5c8-7687-4cc1-b480-6cc39d9c2b66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:57.414794 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-44cfe5c8-7687-4cc1-b480-6cc39d9c2b66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:57.415285 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-44cfe5c8-7687-4cc1-b480-6cc39d9c2b66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:57.416056 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-44cfe5c8-7687-4cc1-b480-6cc39d9c2b66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:57.416494 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-44cfe5c8-7687-4cc1-b480-6cc39d9c2b66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:57.542839 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-44cfe5c8-7687-4cc1-b480-6cc39d9c2b66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:57.550143 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-44cfe5c8-7687-4cc1-b480-6cc39d9c2b66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1556 microversion: 2.1 time: 0.146177 May 12 14:38:57.550655 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 462/907] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:57 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1556 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:38:57.566444 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-aff0e918-a049-4462-9b62-6b037f7b497b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:57.566968 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-aff0e918-a049-4462-9b62-6b037f7b497b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:57.573123 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-aff0e918-a049-4462-9b62-6b037f7b497b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:57.573569 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-aff0e918-a049-4462-9b62-6b037f7b497b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:57.574323 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-aff0e918-a049-4462-9b62-6b037f7b497b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:57.574762 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-aff0e918-a049-4462-9b62-6b037f7b497b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:57.652676 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-aff0e918-a049-4462-9b62-6b037f7b497b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090011 May 12 14:38:57.653274 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 446/908] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 12 14:38:57 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:57.800336 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-95840780-4e23-4f70-8513-f22273ef9a34 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:57.800877 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-95840780-4e23-4f70-8513-f22273ef9a34 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:57.807178 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-95840780-4e23-4f70-8513-f22273ef9a34 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:57.807639 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-95840780-4e23-4f70-8513-f22273ef9a34 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:57.808414 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-95840780-4e23-4f70-8513-f22273ef9a34 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:57.808860 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-95840780-4e23-4f70-8513-f22273ef9a34 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:57.857589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-cd9b621c-8a9b-4d45-8174-4c3bab1f4037 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:57.858397 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-cd9b621c-8a9b-4d45-8174-4c3bab1f4037 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:57.864400 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cd9b621c-8a9b-4d45-8174-4c3bab1f4037 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:57.864851 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cd9b621c-8a9b-4d45-8174-4c3bab1f4037 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:57.865627 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cd9b621c-8a9b-4d45-8174-4c3bab1f4037 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:57.866245 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cd9b621c-8a9b-4d45-8174-4c3bab1f4037 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:58.107605 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-95840780-4e23-4f70-8513-f22273ef9a34 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:58.115387 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-95840780-4e23-4f70-8513-f22273ef9a34 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:58.116958 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-95840780-4e23-4f70-8513-f22273ef9a34 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:58.118207 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-95840780-4e23-4f70-8513-f22273ef9a34 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1407 microversion: 2.20 time: 0.321832 May 12 14:38:58.118852 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 463/909] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:38:57 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:58.188927 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-cd9b621c-8a9b-4d45-8174-4c3bab1f4037 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:58.196861 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-cd9b621c-8a9b-4d45-8174-4c3bab1f4037 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.344148 May 12 14:38:58.197426 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 447/910] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:57 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:38:59.136681 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f4fcdc0f-40bc-4848-ae4d-7369ea18d1cc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:59.137297 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f4fcdc0f-40bc-4848-ae4d-7369ea18d1cc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:59.144633 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f4fcdc0f-40bc-4848-ae4d-7369ea18d1cc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:59.145153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f4fcdc0f-40bc-4848-ae4d-7369ea18d1cc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:59.146718 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f4fcdc0f-40bc-4848-ae4d-7369ea18d1cc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:59.147182 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f4fcdc0f-40bc-4848-ae4d-7369ea18d1cc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:59.214072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-24a4842d-43b6-4b0f-91b3-706513612adb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:59.214931 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-24a4842d-43b6-4b0f-91b3-706513612adb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:38:59.221710 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-24a4842d-43b6-4b0f-91b3-706513612adb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:59.222703 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-24a4842d-43b6-4b0f-91b3-706513612adb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:59.223626 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-24a4842d-43b6-4b0f-91b3-706513612adb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:59.224156 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-24a4842d-43b6-4b0f-91b3-706513612adb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:59.356183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f4fcdc0f-40bc-4848-ae4d-7369ea18d1cc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:59.364552 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f4fcdc0f-40bc-4848-ae4d-7369ea18d1cc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:59.366048 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f4fcdc0f-40bc-4848-ae4d-7369ea18d1cc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:59.367398 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f4fcdc0f-40bc-4848-ae4d-7369ea18d1cc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1407 microversion: 2.20 time: 0.234954 May 12 14:38:59.368274 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 464/911] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:38:59 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:38:59.373315 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-2712a2dd-73d8-41c8-a1d0-24c8ab2b2892 req-f3f480d8-de42-42bb-b7cf-bda1cd2c5fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134a856e-1321-471c-bc31-43307ca41802", "tag": "16daad85-8ecb-4b6e-94ba-93e5f3dce471"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:38:59.381088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-2712a2dd-73d8-41c8-a1d0-24c8ab2b2892 req-f3f480d8-de42-42bb-b7cf-bda1cd2c5fd0 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:38:59.381745 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-2712a2dd-73d8-41c8-a1d0-24c8ab2b2892 req-f3f480d8-de42-42bb-b7cf-bda1cd2c5fd0 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:38:59.393797 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-2712a2dd-73d8-41c8-a1d0-24c8ab2b2892 req-f3f480d8-de42-42bb-b7cf-bda1cd2c5fd0 service nova] Creating event network-changed:16daad85-8ecb-4b6e-94ba-93e5f3dce471 for instance 134a856e-1321-471c-bc31-43307ca41802 on hv-cinder-77703 May 12 14:38:59.394287 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-24a4842d-43b6-4b0f-91b3-706513612adb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:38:59.399170 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-2712a2dd-73d8-41c8-a1d0-24c8ab2b2892 req-f3f480d8-de42-42bb-b7cf-bda1cd2c5fd0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030039 May 12 14:38:59.400211 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 465/912] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:59.406869 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-24a4842d-43b6-4b0f-91b3-706513612adb tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.196836 May 12 14:38:59.407549 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 448/913] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:38:59 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:39:00.386688 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-76bdf7e5-1a03-411a-b158-39dbcb29f133 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:00.387441 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-76bdf7e5-1a03-411a-b158-39dbcb29f133 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:00.394152 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76bdf7e5-1a03-411a-b158-39dbcb29f133 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:00.394606 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76bdf7e5-1a03-411a-b158-39dbcb29f133 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:00.395591 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76bdf7e5-1a03-411a-b158-39dbcb29f133 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:00.396029 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76bdf7e5-1a03-411a-b158-39dbcb29f133 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:00.425498 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d0678040-9aea-47df-b8cd-206f842da95d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:00.426098 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d0678040-9aea-47df-b8cd-206f842da95d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:00.432070 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d0678040-9aea-47df-b8cd-206f842da95d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:00.432525 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d0678040-9aea-47df-b8cd-206f842da95d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:00.433293 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d0678040-9aea-47df-b8cd-206f842da95d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:00.433734 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d0678040-9aea-47df-b8cd-206f842da95d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:00.572101 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-76bdf7e5-1a03-411a-b158-39dbcb29f133 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:00.580744 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-76bdf7e5-1a03-411a-b158-39dbcb29f133 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:00.582258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-76bdf7e5-1a03-411a-b158-39dbcb29f133 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:00.583405 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-76bdf7e5-1a03-411a-b158-39dbcb29f133 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1407 microversion: 2.20 time: 0.201360 May 12 14:39:00.583979 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 466/914] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:39:00 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:39:00.598656 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d0678040-9aea-47df-b8cd-206f842da95d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:00.606300 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d0678040-9aea-47df-b8cd-206f842da95d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.184581 May 12 14:39:00.606932 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 449/915] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:00 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:39:01.601803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e013f764-aea7-479f-9474-87cd7dfd0c6a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:01.602416 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e013f764-aea7-479f-9474-87cd7dfd0c6a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:01.609145 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e013f764-aea7-479f-9474-87cd7dfd0c6a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:01.609599 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e013f764-aea7-479f-9474-87cd7dfd0c6a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:01.610393 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e013f764-aea7-479f-9474-87cd7dfd0c6a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:01.610829 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e013f764-aea7-479f-9474-87cd7dfd0c6a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:01.623416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2c31e16c-dab9-4f44-89f6-d78642d87021 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:01.624029 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2c31e16c-dab9-4f44-89f6-d78642d87021 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:01.630293 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c31e16c-dab9-4f44-89f6-d78642d87021 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:01.630669 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c31e16c-dab9-4f44-89f6-d78642d87021 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:01.631530 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c31e16c-dab9-4f44-89f6-d78642d87021 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:01.631905 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2c31e16c-dab9-4f44-89f6-d78642d87021 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:01.806939 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e013f764-aea7-479f-9474-87cd7dfd0c6a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:01.810762 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2c31e16c-dab9-4f44-89f6-d78642d87021 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:01.816004 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e013f764-aea7-479f-9474-87cd7dfd0c6a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:01.817609 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e013f764-aea7-479f-9474-87cd7dfd0c6a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:01.818531 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2c31e16c-dab9-4f44-89f6-d78642d87021 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.199828 May 12 14:39:01.818872 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e013f764-aea7-479f-9474-87cd7dfd0c6a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1407 microversion: 2.20 time: 0.220872 May 12 14:39:01.819121 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 450/916] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:01 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:39:01.819627 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 467/917] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:39:01 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:39:02.840451 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8e10c2ec-a314-482a-b112-c36b1706bb6b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:02.841960 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-94da8d4d-3f86-4723-bb4f-cca0538ffac8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:02.842649 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-94da8d4d-3f86-4723-bb4f-cca0538ffac8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:02.843500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-8e10c2ec-a314-482a-b112-c36b1706bb6b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:02.853843 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-94da8d4d-3f86-4723-bb4f-cca0538ffac8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:02.854706 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-94da8d4d-3f86-4723-bb4f-cca0538ffac8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:02.855773 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-94da8d4d-3f86-4723-bb4f-cca0538ffac8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:02.856446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-94da8d4d-3f86-4723-bb4f-cca0538ffac8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:02.861217 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8e10c2ec-a314-482a-b112-c36b1706bb6b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:02.861678 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8e10c2ec-a314-482a-b112-c36b1706bb6b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:02.863894 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8e10c2ec-a314-482a-b112-c36b1706bb6b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:02.864902 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8e10c2ec-a314-482a-b112-c36b1706bb6b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:03.124488 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-94da8d4d-3f86-4723-bb4f-cca0538ffac8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:03.132320 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-94da8d4d-3f86-4723-bb4f-cca0538ffac8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.296145 May 12 14:39:03.132899 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 468/918] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:02 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:03.151878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8e10c2ec-a314-482a-b112-c36b1706bb6b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:03.159789 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8e10c2ec-a314-482a-b112-c36b1706bb6b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:03.161319 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8e10c2ec-a314-482a-b112-c36b1706bb6b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:03.162433 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8e10c2ec-a314-482a-b112-c36b1706bb6b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1407 microversion: 2.20 time: 0.329675 May 12 14:39:03.163001 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 451/919] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:39:02 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:39:03.933484 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-09968016-81ce-4029-b329-d24fa9597448 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:03.934100 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-09968016-81ce-4029-b329-d24fa9597448 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:03.940661 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-09968016-81ce-4029-b329-d24fa9597448 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:03.941114 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-09968016-81ce-4029-b329-d24fa9597448 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:03.941888 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-09968016-81ce-4029-b329-d24fa9597448 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:03.942327 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-09968016-81ce-4029-b329-d24fa9597448 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:04.066981 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-09968016-81ce-4029-b329-d24fa9597448 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:04.074685 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-09968016-81ce-4029-b329-d24fa9597448 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1593 microversion: 2.1 time: 0.145011 May 12 14:39:04.075811 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 469/920] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:03 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1593 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:04.149049 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-02ec4a9d-dfbe-4f8d-b276-f9c7ccae66e8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:04.149668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-02ec4a9d-dfbe-4f8d-b276-f9c7ccae66e8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:04.156833 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-02ec4a9d-dfbe-4f8d-b276-f9c7ccae66e8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:04.157287 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-02ec4a9d-dfbe-4f8d-b276-f9c7ccae66e8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:04.158266 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-02ec4a9d-dfbe-4f8d-b276-f9c7ccae66e8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:04.158519 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-02ec4a9d-dfbe-4f8d-b276-f9c7ccae66e8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:04.180923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9055aeb7-6974-4060-8415-bec5ec2fe24a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:04.181823 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9055aeb7-6974-4060-8415-bec5ec2fe24a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:04.188421 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9055aeb7-6974-4060-8415-bec5ec2fe24a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:04.188961 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9055aeb7-6974-4060-8415-bec5ec2fe24a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:04.189827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9055aeb7-6974-4060-8415-bec5ec2fe24a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:04.190342 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9055aeb7-6974-4060-8415-bec5ec2fe24a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:04.422107 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-02ec4a9d-dfbe-4f8d-b276-f9c7ccae66e8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:04.430841 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-02ec4a9d-dfbe-4f8d-b276-f9c7ccae66e8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.285560 May 12 14:39:04.431471 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 452/921] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:04 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:04.475221 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9055aeb7-6974-4060-8415-bec5ec2fe24a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:04.483925 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9055aeb7-6974-4060-8415-bec5ec2fe24a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:04.485449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9055aeb7-6974-4060-8415-bec5ec2fe24a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:04.486558 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9055aeb7-6974-4060-8415-bec5ec2fe24a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1407 microversion: 2.20 time: 0.309688 May 12 14:39:04.487148 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 470/922] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:39:04 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:39:05.242906 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-0b8614b8-dd77-4b0d-b49a-83c9b78832df req-4dcfb42f-9007-4de2-9cab-ef13eb6ef618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533a547e-b44f-4a33-8725-24b323556322", "name": "network-vif-plugged", "status": "completed", "tag": "152a3c94-4ce4-4682-a2c1-1ad44f9d899e"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:05.252555 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-0b8614b8-dd77-4b0d-b49a-83c9b78832df req-4dcfb42f-9007-4de2-9cab-ef13eb6ef618 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:05.253065 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-0b8614b8-dd77-4b0d-b49a-83c9b78832df req-4dcfb42f-9007-4de2-9cab-ef13eb6ef618 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:05.264981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-0b8614b8-dd77-4b0d-b49a-83c9b78832df req-4dcfb42f-9007-4de2-9cab-ef13eb6ef618 service nova] Creating event network-vif-plugged:152a3c94-4ce4-4682-a2c1-1ad44f9d899e for instance 533a547e-b44f-4a33-8725-24b323556322 on hv-cinder-77703 May 12 14:39:05.270003 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-0b8614b8-dd77-4b0d-b49a-83c9b78832df req-4dcfb42f-9007-4de2-9cab-ef13eb6ef618 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032324 May 12 14:39:05.270702 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 453/923] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:05.447722 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2422d1f1-db85-411d-a5b7-174a782ef8fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:05.448335 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2422d1f1-db85-411d-a5b7-174a782ef8fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:05.455905 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2422d1f1-db85-411d-a5b7-174a782ef8fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:05.456468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2422d1f1-db85-411d-a5b7-174a782ef8fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:05.457467 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2422d1f1-db85-411d-a5b7-174a782ef8fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:05.457908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2422d1f1-db85-411d-a5b7-174a782ef8fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:05.504712 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a782adac-924d-4667-9970-d7b293826dae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:05.505327 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a782adac-924d-4667-9970-d7b293826dae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:05.511472 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a782adac-924d-4667-9970-d7b293826dae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:05.511924 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a782adac-924d-4667-9970-d7b293826dae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:05.513294 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a782adac-924d-4667-9970-d7b293826dae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:05.513748 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a782adac-924d-4667-9970-d7b293826dae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:05.814855 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2422d1f1-db85-411d-a5b7-174a782ef8fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:05.822626 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2422d1f1-db85-411d-a5b7-174a782ef8fc tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.378802 May 12 14:39:05.823443 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 471/924] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:05 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:05.843136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a782adac-924d-4667-9970-d7b293826dae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:05.851058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a782adac-924d-4667-9970-d7b293826dae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:05.852677 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a782adac-924d-4667-9970-d7b293826dae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:05.853804 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a782adac-924d-4667-9970-d7b293826dae tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1407 microversion: 2.20 time: 0.353513 May 12 14:39:05.854560 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 454/925] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:39:05 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:39:06.367240 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-53fb6aa2-5d4e-4b78-a278-5bf281a87669 req-68340ec5-561b-455b-9d9c-4700c621bf7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7740cfd0-aec5-4a22-93f7-a460cadea4ac", "tag": "5dfbc34b-96be-4bb8-98e9-1380f31b1266"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:06.376586 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-53fb6aa2-5d4e-4b78-a278-5bf281a87669 req-68340ec5-561b-455b-9d9c-4700c621bf7d service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:06.377037 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-53fb6aa2-5d4e-4b78-a278-5bf281a87669 req-68340ec5-561b-455b-9d9c-4700c621bf7d service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:06.389382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-53fb6aa2-5d4e-4b78-a278-5bf281a87669 req-68340ec5-561b-455b-9d9c-4700c621bf7d service nova] Creating event network-changed:5dfbc34b-96be-4bb8-98e9-1380f31b1266 for instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac on hv-cinder-77703 May 12 14:39:06.395894 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-53fb6aa2-5d4e-4b78-a278-5bf281a87669 req-68340ec5-561b-455b-9d9c-4700c621bf7d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031615 May 12 14:39:06.396497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 472/926] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:06.840590 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8ffd3abb-281f-4a83-b022-50fd7e6bd9de tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:06.842002 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-8ffd3abb-281f-4a83-b022-50fd7e6bd9de tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:06.848812 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8ffd3abb-281f-4a83-b022-50fd7e6bd9de tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:06.849525 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8ffd3abb-281f-4a83-b022-50fd7e6bd9de tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:06.850455 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8ffd3abb-281f-4a83-b022-50fd7e6bd9de tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:06.850957 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8ffd3abb-281f-4a83-b022-50fd7e6bd9de tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:06.872529 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e8f19327-33b5-4055-a00d-9ed0dc5bc80c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:06.873248 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e8f19327-33b5-4055-a00d-9ed0dc5bc80c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:06.882472 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e8f19327-33b5-4055-a00d-9ed0dc5bc80c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:06.882952 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e8f19327-33b5-4055-a00d-9ed0dc5bc80c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:06.883783 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e8f19327-33b5-4055-a00d-9ed0dc5bc80c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:06.884231 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e8f19327-33b5-4055-a00d-9ed0dc5bc80c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:07.094791 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8ffd3abb-281f-4a83-b022-50fd7e6bd9de tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:07.104787 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8ffd3abb-281f-4a83-b022-50fd7e6bd9de tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.268081 May 12 14:39:07.105382 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 455/927] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:06 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:07.120932 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e8f19327-33b5-4055-a00d-9ed0dc5bc80c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:07.132177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e8f19327-33b5-4055-a00d-9ed0dc5bc80c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:07.134046 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e8f19327-33b5-4055-a00d-9ed0dc5bc80c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:07.136141 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e8f19327-33b5-4055-a00d-9ed0dc5bc80c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1407 microversion: 2.20 time: 0.267511 May 12 14:39:07.144753 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 473/928] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:39:06 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:39:07.473861 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-5d2137d7-91b9-4a4c-b981-8ff1e5d7dc50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-24117388"}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:07.474409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-5d2137d7-91b9-4a4c-b981-8ff1e5d7dc50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:07.481168 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5d2137d7-91b9-4a4c-b981-8ff1e5d7dc50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:07.481457 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5d2137d7-91b9-4a4c-b981-8ff1e5d7dc50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:07.482276 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5d2137d7-91b9-4a4c-b981-8ff1e5d7dc50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:07.482724 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5d2137d7-91b9-4a4c-b981-8ff1e5d7dc50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:07.635896 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.network.security_group_api [None req-5d2137d7-91b9-4a4c-b981-8ff1e5d7dc50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Adding security group 9d10a209-0295-4ced-8cf8-33b73d6c1ec1 to port 5dfbc34b-96be-4bb8-98e9-1380f31b1266 May 12 14:39:08.100233 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-5d2137d7-91b9-4a4c-b981-8ff1e5d7dc50 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "POST /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.630162 May 12 14:39:08.100836 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 456/929] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 12 14:39:07 2022] POST /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/action => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:39:08.110411 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-fcd75511-59ce-4087-8cad-0b87e0ab2fda tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:08.111466 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-fcd75511-59ce-4087-8cad-0b87e0ab2fda tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:08.120982 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fcd75511-59ce-4087-8cad-0b87e0ab2fda tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:08.121502 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fcd75511-59ce-4087-8cad-0b87e0ab2fda tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:08.122553 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fcd75511-59ce-4087-8cad-0b87e0ab2fda tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:08.123281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-fcd75511-59ce-4087-8cad-0b87e0ab2fda tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:08.123710 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f543aac5-300a-4bb6-b19a-885a2969f597 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:08.124691 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f543aac5-300a-4bb6-b19a-885a2969f597 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:08.140069 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f543aac5-300a-4bb6-b19a-885a2969f597 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:08.140535 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f543aac5-300a-4bb6-b19a-885a2969f597 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:08.141334 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f543aac5-300a-4bb6-b19a-885a2969f597 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:08.141776 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f543aac5-300a-4bb6-b19a-885a2969f597 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:08.355178 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-fcd75511-59ce-4087-8cad-0b87e0ab2fda tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:08.362552 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f543aac5-300a-4bb6-b19a-885a2969f597 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:08.378289 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-fcd75511-59ce-4087-8cad-0b87e0ab2fda tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1638 microversion: 2.1 time: 0.272418 May 12 14:39:08.379151 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 474/930] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:08 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1638 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:08.384709 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b26db8b7-d438-40a6-b831-902b18015902 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:08.385614 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b26db8b7-d438-40a6-b831-902b18015902 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:08.393541 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b26db8b7-d438-40a6-b831-902b18015902 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:08.394259 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b26db8b7-d438-40a6-b831-902b18015902 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:08.394916 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f543aac5-300a-4bb6-b19a-885a2969f597 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.276897 May 12 14:39:08.395101 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b26db8b7-d438-40a6-b831-902b18015902 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:08.395558 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b26db8b7-d438-40a6-b831-902b18015902 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:08.401272 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 457/931] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:08 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:39:08.417942 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-0d14abba-b5b5-4d1b-8f57-056e455ede41 req-bf6802f0-0534-43be-bd25-ec84319e0ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7740cfd0-aec5-4a22-93f7-a460cadea4ac", "tag": "5dfbc34b-96be-4bb8-98e9-1380f31b1266"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:08.433111 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-0d14abba-b5b5-4d1b-8f57-056e455ede41 req-bf6802f0-0534-43be-bd25-ec84319e0ba7 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:08.433952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-0d14abba-b5b5-4d1b-8f57-056e455ede41 req-bf6802f0-0534-43be-bd25-ec84319e0ba7 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:08.451159 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-0d14abba-b5b5-4d1b-8f57-056e455ede41 req-bf6802f0-0534-43be-bd25-ec84319e0ba7 service nova] Creating event network-changed:5dfbc34b-96be-4bb8-98e9-1380f31b1266 for instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac on hv-cinder-77703 May 12 14:39:08.467623 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-0d14abba-b5b5-4d1b-8f57-056e455ede41 req-bf6802f0-0534-43be-bd25-ec84319e0ba7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054137 May 12 14:39:08.468910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 458/932] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:08.572072 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b26db8b7-d438-40a6-b831-902b18015902 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:08.580693 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b26db8b7-d438-40a6-b831-902b18015902 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:08.582210 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b26db8b7-d438-40a6-b831-902b18015902 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:08.583416 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b26db8b7-d438-40a6-b831-902b18015902 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1599 microversion: 2.20 time: 0.203045 May 12 14:39:08.584177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 475/933] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:39:08 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1599 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:39:08.602596 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-32f398ce-d2fb-4e2c-8f97-109f59183193 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:08.603338 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-32f398ce-d2fb-4e2c-8f97-109f59183193 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:08.611615 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-32f398ce-d2fb-4e2c-8f97-109f59183193 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:08.612200 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-32f398ce-d2fb-4e2c-8f97-109f59183193 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:08.613236 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-32f398ce-d2fb-4e2c-8f97-109f59183193 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:08.613879 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-32f398ce-d2fb-4e2c-8f97-109f59183193 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:08.715402 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-32f398ce-d2fb-4e2c-8f97-109f59183193 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.117328 May 12 14:39:08.715973 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 459/934] 10.222.0.75 () {60 vars in 1315 bytes} [Thu May 12 14:39:08 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:39:09.417652 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-33f7bd84-8f5c-4f41-b525-c5d38bccea41 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:09.418343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-33f7bd84-8f5c-4f41-b525-c5d38bccea41 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:09.425337 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33f7bd84-8f5c-4f41-b525-c5d38bccea41 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:09.425791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33f7bd84-8f5c-4f41-b525-c5d38bccea41 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:09.426569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33f7bd84-8f5c-4f41-b525-c5d38bccea41 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:09.427003 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-33f7bd84-8f5c-4f41-b525-c5d38bccea41 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:09.565422 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-33f7bd84-8f5c-4f41-b525-c5d38bccea41 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:09.573726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-33f7bd84-8f5c-4f41-b525-c5d38bccea41 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.159860 May 12 14:39:09.574323 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 476/935] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:09 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:09.951225 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-a255fd3d-498e-46db-afc5-d4faba3b1882 req-0fc97430-4294-40c8-96a1-afcf6ec6bda2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "533a547e-b44f-4a33-8725-24b323556322", "tag": "152a3c94-4ce4-4682-a2c1-1ad44f9d899e"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:09.959246 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-a255fd3d-498e-46db-afc5-d4faba3b1882 req-0fc97430-4294-40c8-96a1-afcf6ec6bda2 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:09.959889 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-a255fd3d-498e-46db-afc5-d4faba3b1882 req-0fc97430-4294-40c8-96a1-afcf6ec6bda2 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:09.972746 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-a255fd3d-498e-46db-afc5-d4faba3b1882 req-0fc97430-4294-40c8-96a1-afcf6ec6bda2 service nova] Creating event network-changed:152a3c94-4ce4-4682-a2c1-1ad44f9d899e for instance 533a547e-b44f-4a33-8725-24b323556322 on hv-cinder-77703 May 12 14:39:09.978233 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-a255fd3d-498e-46db-afc5-d4faba3b1882 req-0fc97430-4294-40c8-96a1-afcf6ec6bda2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091024 May 12 14:39:09.979825 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 460/936] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:10.590702 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a10266ef-1642-4032-a307-01d5035c4456 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:10.591319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a10266ef-1642-4032-a307-01d5035c4456 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:10.598025 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a10266ef-1642-4032-a307-01d5035c4456 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:10.598487 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a10266ef-1642-4032-a307-01d5035c4456 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:10.599329 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a10266ef-1642-4032-a307-01d5035c4456 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:10.599779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a10266ef-1642-4032-a307-01d5035c4456 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:10.894250 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a10266ef-1642-4032-a307-01d5035c4456 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:10.902042 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a10266ef-1642-4032-a307-01d5035c4456 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.315398 May 12 14:39:10.902608 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 477/937] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:10 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:11.920283 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-5e269073-8e22-43f7-9207-005c2c2da1ee tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:11.920992 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-5e269073-8e22-43f7-9207-005c2c2da1ee tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:11.927477 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5e269073-8e22-43f7-9207-005c2c2da1ee tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:11.927930 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5e269073-8e22-43f7-9207-005c2c2da1ee tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:11.928702 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5e269073-8e22-43f7-9207-005c2c2da1ee tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:11.929141 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5e269073-8e22-43f7-9207-005c2c2da1ee tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:12.057692 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-5e269073-8e22-43f7-9207-005c2c2da1ee tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:12.066239 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-5e269073-8e22-43f7-9207-005c2c2da1ee tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.150281 May 12 14:39:12.066833 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 461/938] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:11 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:13.082960 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0ae919c2-c5f5-4c10-8e9a-513c6154d553 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:13.083688 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0ae919c2-c5f5-4c10-8e9a-513c6154d553 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:13.090007 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0ae919c2-c5f5-4c10-8e9a-513c6154d553 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:13.090475 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0ae919c2-c5f5-4c10-8e9a-513c6154d553 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:13.091329 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0ae919c2-c5f5-4c10-8e9a-513c6154d553 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:13.091773 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0ae919c2-c5f5-4c10-8e9a-513c6154d553 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:13.273082 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0ae919c2-c5f5-4c10-8e9a-513c6154d553 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:13.281366 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0ae919c2-c5f5-4c10-8e9a-513c6154d553 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.202307 May 12 14:39:13.281935 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 478/939] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:13 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:14.298277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-fa9eb92c-0aea-4c23-962a-5b36dab9db03 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:14.298846 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-fa9eb92c-0aea-4c23-962a-5b36dab9db03 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:14.305190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fa9eb92c-0aea-4c23-962a-5b36dab9db03 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:14.305646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fa9eb92c-0aea-4c23-962a-5b36dab9db03 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:14.306435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fa9eb92c-0aea-4c23-962a-5b36dab9db03 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:14.306873 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fa9eb92c-0aea-4c23-962a-5b36dab9db03 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:14.436567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-fa9eb92c-0aea-4c23-962a-5b36dab9db03 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:14.444482 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-fa9eb92c-0aea-4c23-962a-5b36dab9db03 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1735 microversion: 2.1 time: 0.150687 May 12 14:39:14.445046 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 462/940] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:14 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:15.461300 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7b1390b0-977c-4195-88f7-75cf3f35ad8f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:15.461922 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7b1390b0-977c-4195-88f7-75cf3f35ad8f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:15.468782 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7b1390b0-977c-4195-88f7-75cf3f35ad8f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:15.469240 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7b1390b0-977c-4195-88f7-75cf3f35ad8f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:15.470019 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7b1390b0-977c-4195-88f7-75cf3f35ad8f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:15.470461 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7b1390b0-977c-4195-88f7-75cf3f35ad8f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:15.599365 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7b1390b0-977c-4195-88f7-75cf3f35ad8f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:15.607780 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7b1390b0-977c-4195-88f7-75cf3f35ad8f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1715 microversion: 2.1 time: 0.150318 May 12 14:39:15.608334 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 479/941] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:15 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:15.660778 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0f5b6307-0f59-4709-bcbd-9d42a76ae2d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:15.661279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0f5b6307-0f59-4709-bcbd-9d42a76ae2d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:15.667589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0f5b6307-0f59-4709-bcbd-9d42a76ae2d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:15.668045 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0f5b6307-0f59-4709-bcbd-9d42a76ae2d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:15.669438 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0f5b6307-0f59-4709-bcbd-9d42a76ae2d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:15.669878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0f5b6307-0f59-4709-bcbd-9d42a76ae2d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:15.751127 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-0f5b6307-0f59-4709-bcbd-9d42a76ae2d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] HTTP exception thrown: Cannot 'detach_volume' instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d while it is in vm_state rescued May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0f5b6307-0f59-4709-bcbd-9d42a76ae2d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Request method failure captured: May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: DELETE /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-volume_attachments/c66f6872-c8ed-4315-a1e9-2f4fb21f982f HTTP/1.1 May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRq0uWuP3TVHlLteeytECkdY1IHk4Hm4jgv2EqCnNnd6d7UG3PWB-NuAqkTLkf0WOJPkE44_BXmJ11jpUpyyW5sLjohov-DKwiXHfMHAMPjixk4n1DyvIkCubo7puSPwFp_XC3lYOHR3XN9hdOa8f44jvM5ppqXDZozdTAyrt_DDmpY May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 3c83c8fa2cd44eab84cb50b3ad06a1d3 May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1594015429 May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:39:15.753470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:39:15.754970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3c83c8fa2cd44eab84cb50b3ad06a1d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c83c8fa2cd44eab84cb50b3ad06a1d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3c83c8fa2cd44eab84cb50b3ad06a1d3", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c83c8fa2cd44eab84cb50b3ad06a1d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:39:15.754970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1594015429 May 12 14:39:15.754970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 3c83c8fa2cd44eab84cb50b3ad06a1d3 May 12 14:39:15.754970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1594015429 May 12 14:39:15.754970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-ServerRescueNegativeTestJSON-1594015429-project May 12 14:39:15.754970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:39:15.754970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:39:15.754970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: 2cfa47f1da4e4ae9a358e2b8ace795ac May 12 14:39:15.754970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1594015429-project May 12 14:39:15.754970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:39:15.754970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Cannot 'detach_volume' instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d while it is in vm_state rescued May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'server_id': '26e40740-6dab-4657-abc3-eb83ee4b4c4d', 'id': 'c66f6872-c8ed-4315-a1e9-2f4fb21f982f'} May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d in vm_state rescued. Cannot detach_volume while the instance is in this state. May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:39:15.755952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d while it is in vm_state rescued May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d while it is in vm_state rescued May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:39:15.757409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0f5b6307-0f59-4709-bcbd-9d42a76ae2d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Returning 409 to user: Cannot 'detach_volume' instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d while it is in vm_state rescued {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:39:15.758381 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0f5b6307-0f59-4709-bcbd-9d42a76ae2d3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "DELETE /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-volume_attachments/c66f6872-c8ed-4315-a1e9-2f4fb21f982f" status: 409 len: 152 microversion: 2.1 time: 0.098147 May 12 14:39:15.758381 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 463/942] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 12 14:39:15 2022] DELETE /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-volume_attachments/c66f6872-c8ed-4315-a1e9-2f4fb21f982f => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 14:39:15.763878 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-74307825-08f3-45bd-9f24-826f85260c1d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:15.764414 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-74307825-08f3-45bd-9f24-826f85260c1d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:15.770140 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-74307825-08f3-45bd-9f24-826f85260c1d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:15.770592 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-74307825-08f3-45bd-9f24-826f85260c1d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:15.771388 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-74307825-08f3-45bd-9f24-826f85260c1d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:15.771827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-74307825-08f3-45bd-9f24-826f85260c1d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:15.835644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-74307825-08f3-45bd-9f24-826f85260c1d tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "POST /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/action" status: 202 len: 0 microversion: 2.1 time: 0.075426 May 12 14:39:15.836267 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 480/943] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 12 14:39:15 2022] POST /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:39:15.844973 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c3a4b81c-48f4-419c-ab0c-712026113cec tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:15.845619 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c3a4b81c-48f4-419c-ab0c-712026113cec tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:15.852474 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c3a4b81c-48f4-419c-ab0c-712026113cec tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:15.853011 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c3a4b81c-48f4-419c-ab0c-712026113cec tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:15.853784 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c3a4b81c-48f4-419c-ab0c-712026113cec tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:15.854221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c3a4b81c-48f4-419c-ab0c-712026113cec tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:16.062272 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c3a4b81c-48f4-419c-ab0c-712026113cec tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:16.070130 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c3a4b81c-48f4-419c-ab0c-712026113cec tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1723 microversion: 2.1 time: 0.229576 May 12 14:39:16.070699 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 464/944] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:15 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:39:17.088885 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1af8c8a4-3ceb-44be-af4e-6c03ed724397 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:17.089592 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1af8c8a4-3ceb-44be-af4e-6c03ed724397 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:17.096401 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1af8c8a4-3ceb-44be-af4e-6c03ed724397 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:17.096861 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1af8c8a4-3ceb-44be-af4e-6c03ed724397 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:17.097636 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1af8c8a4-3ceb-44be-af4e-6c03ed724397 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:17.098078 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1af8c8a4-3ceb-44be-af4e-6c03ed724397 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:17.226390 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1af8c8a4-3ceb-44be-af4e-6c03ed724397 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:17.234874 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1af8c8a4-3ceb-44be-af4e-6c03ed724397 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1723 microversion: 2.1 time: 0.150703 May 12 14:39:17.235479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 481/945] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:17 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:39:18.252570 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f212cfe8-2496-47f4-b7e3-872dd9fbf695 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:18.253141 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f212cfe8-2496-47f4-b7e3-872dd9fbf695 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:18.259459 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f212cfe8-2496-47f4-b7e3-872dd9fbf695 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:18.259913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f212cfe8-2496-47f4-b7e3-872dd9fbf695 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:18.260683 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f212cfe8-2496-47f4-b7e3-872dd9fbf695 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:18.261121 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f212cfe8-2496-47f4-b7e3-872dd9fbf695 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:18.390443 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f212cfe8-2496-47f4-b7e3-872dd9fbf695 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:18.398208 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f212cfe8-2496-47f4-b7e3-872dd9fbf695 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1723 microversion: 2.1 time: 0.149564 May 12 14:39:18.398788 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 465/946] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:18 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:19.415935 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0fd9c606-7112-4688-9a03-0bd7f0ac5620 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:19.416566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0fd9c606-7112-4688-9a03-0bd7f0ac5620 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:19.423618 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0fd9c606-7112-4688-9a03-0bd7f0ac5620 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:19.424082 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0fd9c606-7112-4688-9a03-0bd7f0ac5620 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:19.424861 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0fd9c606-7112-4688-9a03-0bd7f0ac5620 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:19.425310 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0fd9c606-7112-4688-9a03-0bd7f0ac5620 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:19.549632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0fd9c606-7112-4688-9a03-0bd7f0ac5620 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:19.557278 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0fd9c606-7112-4688-9a03-0bd7f0ac5620 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1723 microversion: 2.1 time: 0.145201 May 12 14:39:19.557833 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 482/947] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:19 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:39:20.574423 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-795e266d-df58-4a7f-b425-bb4620130848 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:20.575049 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-795e266d-df58-4a7f-b425-bb4620130848 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:20.581271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-795e266d-df58-4a7f-b425-bb4620130848 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:20.581715 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-795e266d-df58-4a7f-b425-bb4620130848 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:20.582484 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-795e266d-df58-4a7f-b425-bb4620130848 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:20.582919 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-795e266d-df58-4a7f-b425-bb4620130848 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:20.709397 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-795e266d-df58-4a7f-b425-bb4620130848 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:20.717608 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-795e266d-df58-4a7f-b425-bb4620130848 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1729 microversion: 2.1 time: 0.147114 May 12 14:39:20.718176 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 466/948] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:20 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1729 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:20.734405 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5c1a8399-05b4-4cdf-8c1d-791d6c192e31 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:20.734945 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5c1a8399-05b4-4cdf-8c1d-791d6c192e31 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:20.741232 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5c1a8399-05b4-4cdf-8c1d-791d6c192e31 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:20.741698 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5c1a8399-05b4-4cdf-8c1d-791d6c192e31 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:20.742474 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5c1a8399-05b4-4cdf-8c1d-791d6c192e31 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:20.742957 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5c1a8399-05b4-4cdf-8c1d-791d6c192e31 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:20.820028 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5c1a8399-05b4-4cdf-8c1d-791d6c192e31 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090133 May 12 14:39:20.820622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 483/949] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 12 14:39:20 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:21.318885 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e7632d6a-1f8f-4a96-9854-7bd9ebfe03d0 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:21.319533 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e7632d6a-1f8f-4a96-9854-7bd9ebfe03d0 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:21.326404 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7632d6a-1f8f-4a96-9854-7bd9ebfe03d0 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:21.326864 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7632d6a-1f8f-4a96-9854-7bd9ebfe03d0 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:21.327789 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7632d6a-1f8f-4a96-9854-7bd9ebfe03d0 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:21.328169 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7632d6a-1f8f-4a96-9854-7bd9ebfe03d0 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:21.354210 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-e7632d6a-1f8f-4a96-9854-7bd9ebfe03d0 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lazy-loading 'flavor' on Instance uuid ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:39:21.431629 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e7632d6a-1f8f-4a96-9854-7bd9ebfe03d0 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "POST /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef/action" status: 202 len: 0 microversion: 2.1 time: 0.116503 May 12 14:39:21.436101 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 467/950] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 12 14:39:21 2022] POST /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:39:21.453816 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9b5276be-d69f-4d8f-af3b-590511740160 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:21.455493 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9b5276be-d69f-4d8f-af3b-590511740160 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:21.462443 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9b5276be-d69f-4d8f-af3b-590511740160 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:21.463009 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9b5276be-d69f-4d8f-af3b-590511740160 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:21.463939 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9b5276be-d69f-4d8f-af3b-590511740160 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:21.464474 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9b5276be-d69f-4d8f-af3b-590511740160 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:21.678935 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9b5276be-d69f-4d8f-af3b-590511740160 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:21.687580 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9b5276be-d69f-4d8f-af3b-590511740160 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.250042 May 12 14:39:21.688313 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 484/951] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:21 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:22.084427 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-8bfbc5f0-ca86-44be-8ed6-0d6c0f7ed698 req-8d30bc26-8b54-4edb-b42a-9a45cfe4c6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e40740-6dab-4657-abc3-eb83ee4b4c4d", "tag": "1d9bd042-8dc9-4559-9211-62f3a465dca4"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:22.094832 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-8bfbc5f0-ca86-44be-8ed6-0d6c0f7ed698 req-8d30bc26-8b54-4edb-b42a-9a45cfe4c6a3 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:22.095303 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-8bfbc5f0-ca86-44be-8ed6-0d6c0f7ed698 req-8d30bc26-8b54-4edb-b42a-9a45cfe4c6a3 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:22.106646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-8bfbc5f0-ca86-44be-8ed6-0d6c0f7ed698 req-8d30bc26-8b54-4edb-b42a-9a45cfe4c6a3 service nova] Creating event network-changed:1d9bd042-8dc9-4559-9211-62f3a465dca4 for instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d on hv-cinder-77703 May 12 14:39:22.112033 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-8bfbc5f0-ca86-44be-8ed6-0d6c0f7ed698 req-8d30bc26-8b54-4edb-b42a-9a45cfe4c6a3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031344 May 12 14:39:22.112625 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 468/952] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:22.706048 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-dbecc1b6-2a1d-4268-a992-cafd21cdc95d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:22.706629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-dbecc1b6-2a1d-4268-a992-cafd21cdc95d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:22.724783 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dbecc1b6-2a1d-4268-a992-cafd21cdc95d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:22.725705 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dbecc1b6-2a1d-4268-a992-cafd21cdc95d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:22.726679 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dbecc1b6-2a1d-4268-a992-cafd21cdc95d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:22.727236 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dbecc1b6-2a1d-4268-a992-cafd21cdc95d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:22.859635 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-dbecc1b6-2a1d-4268-a992-cafd21cdc95d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:22.867116 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-dbecc1b6-2a1d-4268-a992-cafd21cdc95d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.165081 May 12 14:39:22.867697 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 485/953] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:22 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:23.885432 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-48ad04ae-df50-465d-9a04-7ae5a1842d62 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:23.886127 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-48ad04ae-df50-465d-9a04-7ae5a1842d62 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:23.892657 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48ad04ae-df50-465d-9a04-7ae5a1842d62 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:23.893100 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48ad04ae-df50-465d-9a04-7ae5a1842d62 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:23.893859 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48ad04ae-df50-465d-9a04-7ae5a1842d62 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:23.894291 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48ad04ae-df50-465d-9a04-7ae5a1842d62 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:24.028466 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-48ad04ae-df50-465d-9a04-7ae5a1842d62 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:24.035843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-48ad04ae-df50-465d-9a04-7ae5a1842d62 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.154585 May 12 14:39:24.036418 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 469/954] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:23 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:24.126561 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-77598404-9fbf-494d-b1f2-2a0700fafbee req-fddc23d7-c80d-4de8-9524-1a0d11f79f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e40740-6dab-4657-abc3-eb83ee4b4c4d", "tag": "1d9bd042-8dc9-4559-9211-62f3a465dca4"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:24.134825 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-77598404-9fbf-494d-b1f2-2a0700fafbee req-fddc23d7-c80d-4de8-9524-1a0d11f79f24 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:24.135335 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-77598404-9fbf-494d-b1f2-2a0700fafbee req-fddc23d7-c80d-4de8-9524-1a0d11f79f24 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:24.146334 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-77598404-9fbf-494d-b1f2-2a0700fafbee req-fddc23d7-c80d-4de8-9524-1a0d11f79f24 service nova] Creating event network-changed:1d9bd042-8dc9-4559-9211-62f3a465dca4 for instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d on hv-cinder-77703 May 12 14:39:24.151079 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-77598404-9fbf-494d-b1f2-2a0700fafbee req-fddc23d7-c80d-4de8-9524-1a0d11f79f24 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028121 May 12 14:39:24.151621 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 486/955] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:25.053845 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-48f4753b-43d1-415e-b171-3041eafbb972 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:25.054604 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-48f4753b-43d1-415e-b171-3041eafbb972 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:25.061216 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48f4753b-43d1-415e-b171-3041eafbb972 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:25.061667 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48f4753b-43d1-415e-b171-3041eafbb972 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:25.062426 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48f4753b-43d1-415e-b171-3041eafbb972 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:25.062869 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48f4753b-43d1-415e-b171-3041eafbb972 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:25.196034 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-48f4753b-43d1-415e-b171-3041eafbb972 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:25.203939 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-48f4753b-43d1-415e-b171-3041eafbb972 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.153947 May 12 14:39:25.204717 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 470/956] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:25 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:26.222548 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-07a919bd-39a9-4389-b4dd-7a910a862bfa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:26.223197 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-07a919bd-39a9-4389-b4dd-7a910a862bfa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:26.229326 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-07a919bd-39a9-4389-b4dd-7a910a862bfa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:26.229789 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-07a919bd-39a9-4389-b4dd-7a910a862bfa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:26.231264 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-07a919bd-39a9-4389-b4dd-7a910a862bfa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:26.231721 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-07a919bd-39a9-4389-b4dd-7a910a862bfa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:26.375067 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-07a919bd-39a9-4389-b4dd-7a910a862bfa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:26.382775 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-07a919bd-39a9-4389-b4dd-7a910a862bfa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.164998 May 12 14:39:26.383399 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 487/957] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:26 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:27.399766 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3101cf54-ecf6-445f-b938-ae180e25d279 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:27.400386 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3101cf54-ecf6-445f-b938-ae180e25d279 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:27.407202 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3101cf54-ecf6-445f-b938-ae180e25d279 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:27.407651 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3101cf54-ecf6-445f-b938-ae180e25d279 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:27.408411 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3101cf54-ecf6-445f-b938-ae180e25d279 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:27.408841 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3101cf54-ecf6-445f-b938-ae180e25d279 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:27.534272 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3101cf54-ecf6-445f-b938-ae180e25d279 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:27.541479 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3101cf54-ecf6-445f-b938-ae180e25d279 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.145509 May 12 14:39:27.542134 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 471/958] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:27 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:28.559691 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d9395956-01c5-40e2-9605-12134c791a57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:28.560302 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d9395956-01c5-40e2-9605-12134c791a57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:28.566529 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d9395956-01c5-40e2-9605-12134c791a57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:28.566981 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d9395956-01c5-40e2-9605-12134c791a57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:28.567775 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d9395956-01c5-40e2-9605-12134c791a57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:28.568213 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d9395956-01c5-40e2-9605-12134c791a57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:28.695525 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d9395956-01c5-40e2-9605-12134c791a57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:28.702874 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d9395956-01c5-40e2-9605-12134c791a57 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.147730 May 12 14:39:28.703472 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 488/959] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:28 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:29.720055 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-5121322f-6891-43bb-a9aa-5f130425c9be tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:29.720671 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-5121322f-6891-43bb-a9aa-5f130425c9be tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:29.727342 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5121322f-6891-43bb-a9aa-5f130425c9be tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:29.727483 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5121322f-6891-43bb-a9aa-5f130425c9be tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:29.728275 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5121322f-6891-43bb-a9aa-5f130425c9be tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:29.728713 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5121322f-6891-43bb-a9aa-5f130425c9be tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:29.860394 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-5121322f-6891-43bb-a9aa-5f130425c9be tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:29.867647 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-5121322f-6891-43bb-a9aa-5f130425c9be tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.151445 May 12 14:39:29.868226 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 472/960] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:29 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:30.885460 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1edd925f-7d7f-4a22-83e6-efcb00ec2bf4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:30.886091 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1edd925f-7d7f-4a22-83e6-efcb00ec2bf4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:30.892985 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1edd925f-7d7f-4a22-83e6-efcb00ec2bf4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:30.893442 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1edd925f-7d7f-4a22-83e6-efcb00ec2bf4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:30.894227 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1edd925f-7d7f-4a22-83e6-efcb00ec2bf4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:30.894682 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1edd925f-7d7f-4a22-83e6-efcb00ec2bf4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:31.029927 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1edd925f-7d7f-4a22-83e6-efcb00ec2bf4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:31.037171 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1edd925f-7d7f-4a22-83e6-efcb00ec2bf4 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.155590 May 12 14:39:31.037736 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 489/961] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:30 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:32.152120 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-bc26c54f-0a0e-4adf-87a1-93961072955f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:32.152929 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-bc26c54f-0a0e-4adf-87a1-93961072955f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:32.158700 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bc26c54f-0a0e-4adf-87a1-93961072955f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:32.159187 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bc26c54f-0a0e-4adf-87a1-93961072955f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:32.159960 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bc26c54f-0a0e-4adf-87a1-93961072955f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:32.160398 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bc26c54f-0a0e-4adf-87a1-93961072955f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:32.355764 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-bc26c54f-0a0e-4adf-87a1-93961072955f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:32.362987 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-bc26c54f-0a0e-4adf-87a1-93961072955f tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.313087 May 12 14:39:32.363589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 473/962] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:32 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:33.381207 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bd10e104-b2bb-410f-b913-15ed64d8d1cd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:33.381831 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bd10e104-b2bb-410f-b913-15ed64d8d1cd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:33.389072 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bd10e104-b2bb-410f-b913-15ed64d8d1cd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:33.389533 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bd10e104-b2bb-410f-b913-15ed64d8d1cd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:33.390317 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bd10e104-b2bb-410f-b913-15ed64d8d1cd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:33.390764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bd10e104-b2bb-410f-b913-15ed64d8d1cd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:33.520132 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bd10e104-b2bb-410f-b913-15ed64d8d1cd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:33.527921 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bd10e104-b2bb-410f-b913-15ed64d8d1cd tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.150029 May 12 14:39:33.528488 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 490/963] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:33 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:34.545360 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-04282b43-cfa2-4ba0-aaea-f1c7443b6b8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:34.545979 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-04282b43-cfa2-4ba0-aaea-f1c7443b6b8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:34.552639 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-04282b43-cfa2-4ba0-aaea-f1c7443b6b8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:34.553101 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-04282b43-cfa2-4ba0-aaea-f1c7443b6b8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:34.553875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-04282b43-cfa2-4ba0-aaea-f1c7443b6b8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:34.554313 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-04282b43-cfa2-4ba0-aaea-f1c7443b6b8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:34.688063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-04282b43-cfa2-4ba0-aaea-f1c7443b6b8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:34.695373 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-04282b43-cfa2-4ba0-aaea-f1c7443b6b8a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.154438 May 12 14:39:34.695938 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 474/964] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:34 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:35.712277 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-288f0724-01b6-47af-bc70-5d1876b80349 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:35.712902 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-288f0724-01b6-47af-bc70-5d1876b80349 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:35.719271 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-288f0724-01b6-47af-bc70-5d1876b80349 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:35.719731 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-288f0724-01b6-47af-bc70-5d1876b80349 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:35.720505 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-288f0724-01b6-47af-bc70-5d1876b80349 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:35.720947 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-288f0724-01b6-47af-bc70-5d1876b80349 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:35.846057 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-288f0724-01b6-47af-bc70-5d1876b80349 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:35.853479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-288f0724-01b6-47af-bc70-5d1876b80349 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1509 microversion: 2.1 time: 0.145114 May 12 14:39:35.854039 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 491/965] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:35 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1509 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:35.869858 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a501bea1-49a9-449b-abcf-89e79e383d09 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:35.870475 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a501bea1-49a9-449b-abcf-89e79e383d09 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:35.877242 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a501bea1-49a9-449b-abcf-89e79e383d09 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:35.877691 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a501bea1-49a9-449b-abcf-89e79e383d09 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:35.878497 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a501bea1-49a9-449b-abcf-89e79e383d09 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:35.878932 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a501bea1-49a9-449b-abcf-89e79e383d09 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:35.950438 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a501bea1-49a9-449b-abcf-89e79e383d09 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "POST /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef/action" status: 202 len: 0 microversion: 2.1 time: 0.084624 May 12 14:39:35.951090 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 475/966] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 12 14:39:35 2022] POST /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:39:35.959196 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-02bb1e91-07f7-4c62-ae19-ab18348df7d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:35.961183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-02bb1e91-07f7-4c62-ae19-ab18348df7d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:35.967542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-02bb1e91-07f7-4c62-ae19-ab18348df7d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:35.968011 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-02bb1e91-07f7-4c62-ae19-ab18348df7d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:35.968835 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-02bb1e91-07f7-4c62-ae19-ab18348df7d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:35.969280 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-02bb1e91-07f7-4c62-ae19-ab18348df7d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:36.103073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-02bb1e91-07f7-4c62-ae19-ab18348df7d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:36.111143 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-02bb1e91-07f7-4c62-ae19-ab18348df7d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1517 microversion: 2.1 time: 0.155811 May 12 14:39:36.111728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 492/967] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:35 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:37.129684 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-5c89c715-f151-4502-ad26-9f67453f46c1 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:37.130301 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-5c89c715-f151-4502-ad26-9f67453f46c1 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:37.137302 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5c89c715-f151-4502-ad26-9f67453f46c1 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:37.137753 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5c89c715-f151-4502-ad26-9f67453f46c1 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:37.138522 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5c89c715-f151-4502-ad26-9f67453f46c1 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:37.138960 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5c89c715-f151-4502-ad26-9f67453f46c1 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:37.265722 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-5c89c715-f151-4502-ad26-9f67453f46c1 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:37.273045 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-5c89c715-f151-4502-ad26-9f67453f46c1 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1519 microversion: 2.1 time: 0.147277 May 12 14:39:37.273644 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 476/968] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:37 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:37.531724 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-95926f12-0f6a-4e0a-aef9-b29c2530f7a9 req-c1dc285e-f6f7-49e0-a4dd-d3cf911c6dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef", "name": "network-vif-unplugged", "status": "completed", "tag": "228c90b8-3a08-410b-be25-ba639362a959"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:37.540543 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-95926f12-0f6a-4e0a-aef9-b29c2530f7a9 req-c1dc285e-f6f7-49e0-a4dd-d3cf911c6dbf service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:37.541142 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-95926f12-0f6a-4e0a-aef9-b29c2530f7a9 req-c1dc285e-f6f7-49e0-a4dd-d3cf911c6dbf service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:37.554537 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.compute.server_external_events [req-95926f12-0f6a-4e0a-aef9-b29c2530f7a9 req-c1dc285e-f6f7-49e0-a4dd-d3cf911c6dbf service nova] Unable to find a host for instance ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef. Dropping event network-vif-unplugged {{(pid=118217) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 12 14:39:37.555555 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-95926f12-0f6a-4e0a-aef9-b29c2530f7a9 req-c1dc285e-f6f7-49e0-a4dd-d3cf911c6dbf service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030274 May 12 14:39:37.556394 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 493/969] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 12 14:39:38.289627 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-92783b0d-da0f-46cc-9a88-df3f003e5328 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:38.290234 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-92783b0d-da0f-46cc-9a88-df3f003e5328 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:38.297037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-92783b0d-da0f-46cc-9a88-df3f003e5328 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:38.297484 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-92783b0d-da0f-46cc-9a88-df3f003e5328 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:38.298252 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-92783b0d-da0f-46cc-9a88-df3f003e5328 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:38.298686 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-92783b0d-da0f-46cc-9a88-df3f003e5328 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:38.507720 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-92783b0d-da0f-46cc-9a88-df3f003e5328 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:38.515246 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-92783b0d-da0f-46cc-9a88-df3f003e5328 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1575 microversion: 2.1 time: 0.229413 May 12 14:39:38.515839 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 477/970] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:38 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:39.532431 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-458923b0-22c6-4acb-a9be-b3b0f5fc2257 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:39.533106 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-458923b0-22c6-4acb-a9be-b3b0f5fc2257 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:39.539331 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-458923b0-22c6-4acb-a9be-b3b0f5fc2257 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:39.539784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-458923b0-22c6-4acb-a9be-b3b0f5fc2257 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:39.540549 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-458923b0-22c6-4acb-a9be-b3b0f5fc2257 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:39.540985 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-458923b0-22c6-4acb-a9be-b3b0f5fc2257 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:39.665944 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-458923b0-22c6-4acb-a9be-b3b0f5fc2257 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:39.673150 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-458923b0-22c6-4acb-a9be-b3b0f5fc2257 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1575 microversion: 2.1 time: 0.144538 May 12 14:39:39.673720 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 494/971] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:39 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1575 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:40.690099 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-eb78337d-2d57-431e-97a1-f9a6950be788 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:40.690711 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-eb78337d-2d57-431e-97a1-f9a6950be788 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:40.697008 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb78337d-2d57-431e-97a1-f9a6950be788 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:40.697460 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb78337d-2d57-431e-97a1-f9a6950be788 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:40.698233 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb78337d-2d57-431e-97a1-f9a6950be788 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:40.699229 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb78337d-2d57-431e-97a1-f9a6950be788 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:41.081806 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-eb78337d-2d57-431e-97a1-f9a6950be788 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:41.089209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-eb78337d-2d57-431e-97a1-f9a6950be788 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1575 microversion: 2.1 time: 0.402891 May 12 14:39:41.089708 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 478/972] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:40 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1575 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:42.105868 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-98b16567-d231-4bd2-bef8-7a4603c06e41 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:42.106514 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-98b16567-d231-4bd2-bef8-7a4603c06e41 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:42.113156 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-98b16567-d231-4bd2-bef8-7a4603c06e41 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:42.113610 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-98b16567-d231-4bd2-bef8-7a4603c06e41 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:42.114389 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-98b16567-d231-4bd2-bef8-7a4603c06e41 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:42.114833 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-98b16567-d231-4bd2-bef8-7a4603c06e41 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:42.244107 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-98b16567-d231-4bd2-bef8-7a4603c06e41 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:42.251493 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-98b16567-d231-4bd2-bef8-7a4603c06e41 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1575 microversion: 2.1 time: 0.149532 May 12 14:39:42.252068 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 495/973] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:42 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:43.268718 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9af892df-5c9a-4d40-8c70-754f769ee20c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:43.269254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9af892df-5c9a-4d40-8c70-754f769ee20c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:43.275527 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9af892df-5c9a-4d40-8c70-754f769ee20c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:43.275970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9af892df-5c9a-4d40-8c70-754f769ee20c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:43.277246 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9af892df-5c9a-4d40-8c70-754f769ee20c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:43.277672 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9af892df-5c9a-4d40-8c70-754f769ee20c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:43.407440 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9af892df-5c9a-4d40-8c70-754f769ee20c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:43.414737 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9af892df-5c9a-4d40-8c70-754f769ee20c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1575 microversion: 2.1 time: 0.150143 May 12 14:39:43.415335 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 479/974] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:43 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:44.431484 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-6d17eb68-71cc-4e71-9069-8cd4140d2d3c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:44.432093 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-6d17eb68-71cc-4e71-9069-8cd4140d2d3c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:44.438855 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6d17eb68-71cc-4e71-9069-8cd4140d2d3c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:44.439344 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6d17eb68-71cc-4e71-9069-8cd4140d2d3c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:44.440112 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6d17eb68-71cc-4e71-9069-8cd4140d2d3c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:44.440561 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6d17eb68-71cc-4e71-9069-8cd4140d2d3c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:44.569991 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-6d17eb68-71cc-4e71-9069-8cd4140d2d3c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:44.577918 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-6d17eb68-71cc-4e71-9069-8cd4140d2d3c tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1575 microversion: 2.1 time: 0.150263 May 12 14:39:44.578483 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 496/975] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:44 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:45.595468 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-cc89a155-7500-4aaf-8666-a7cd85170aff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:45.596085 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-cc89a155-7500-4aaf-8666-a7cd85170aff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:45.602377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cc89a155-7500-4aaf-8666-a7cd85170aff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:45.602819 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cc89a155-7500-4aaf-8666-a7cd85170aff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:45.603607 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cc89a155-7500-4aaf-8666-a7cd85170aff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:45.604047 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cc89a155-7500-4aaf-8666-a7cd85170aff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:45.732113 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-cc89a155-7500-4aaf-8666-a7cd85170aff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:45.739362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-cc89a155-7500-4aaf-8666-a7cd85170aff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1575 microversion: 2.1 time: 0.147693 May 12 14:39:45.739939 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 480/976] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:45 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:46.756823 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-819765e4-6c3e-43dd-8005-c04088909dff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:46.757462 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-819765e4-6c3e-43dd-8005-c04088909dff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:46.764002 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-819765e4-6c3e-43dd-8005-c04088909dff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:46.764461 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-819765e4-6c3e-43dd-8005-c04088909dff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:46.765233 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-819765e4-6c3e-43dd-8005-c04088909dff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:46.765677 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-819765e4-6c3e-43dd-8005-c04088909dff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:46.896315 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-819765e4-6c3e-43dd-8005-c04088909dff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:46.904281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-819765e4-6c3e-43dd-8005-c04088909dff tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1575 microversion: 2.1 time: 0.151469 May 12 14:39:46.904847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 497/977] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:46 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:47.921352 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-88b5a859-9937-4013-b85c-14a0a2bbc439 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:47.921963 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-88b5a859-9937-4013-b85c-14a0a2bbc439 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:47.928418 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-88b5a859-9937-4013-b85c-14a0a2bbc439 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:47.928862 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-88b5a859-9937-4013-b85c-14a0a2bbc439 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:47.929624 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-88b5a859-9937-4013-b85c-14a0a2bbc439 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:47.930055 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-88b5a859-9937-4013-b85c-14a0a2bbc439 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:48.058788 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-88b5a859-9937-4013-b85c-14a0a2bbc439 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:48.066039 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-88b5a859-9937-4013-b85c-14a0a2bbc439 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1575 microversion: 2.1 time: 0.148635 May 12 14:39:48.066612 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 481/978] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:47 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:49.083102 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9e6c3e33-0876-4bf1-b669-068b235b532a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:49.083726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9e6c3e33-0876-4bf1-b669-068b235b532a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:49.091093 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9e6c3e33-0876-4bf1-b669-068b235b532a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:49.091560 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9e6c3e33-0876-4bf1-b669-068b235b532a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:49.092342 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9e6c3e33-0876-4bf1-b669-068b235b532a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:49.092785 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9e6c3e33-0876-4bf1-b669-068b235b532a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:49.222010 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9e6c3e33-0876-4bf1-b669-068b235b532a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:49.229206 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9e6c3e33-0876-4bf1-b669-068b235b532a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1575 microversion: 2.1 time: 0.150049 May 12 14:39:49.229776 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 498/979] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:49 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:49.702569 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-15d2f5b2-6322-4584-9fe0-17276ec5ed57 req-3d18feb6-8e59-4be4-8241-936f9796e38e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef", "name": "network-vif-plugged", "status": "completed", "tag": "228c90b8-3a08-410b-be25-ba639362a959"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:49.711588 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-15d2f5b2-6322-4584-9fe0-17276ec5ed57 req-3d18feb6-8e59-4be4-8241-936f9796e38e service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:49.712054 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-15d2f5b2-6322-4584-9fe0-17276ec5ed57 req-3d18feb6-8e59-4be4-8241-936f9796e38e service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:49.723251 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-15d2f5b2-6322-4584-9fe0-17276ec5ed57 req-3d18feb6-8e59-4be4-8241-936f9796e38e service nova] Creating event network-vif-plugged:228c90b8-3a08-410b-be25-ba639362a959 for instance ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef on hv-cinder-77703 May 12 14:39:49.728219 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-15d2f5b2-6322-4584-9fe0-17276ec5ed57 req-3d18feb6-8e59-4be4-8241-936f9796e38e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029395 May 12 14:39:49.728976 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 482/980] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:50.246081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-31082056-4bb2-44e9-ac6f-fec7604cb14b tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:50.246648 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-31082056-4bb2-44e9-ac6f-fec7604cb14b tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:50.252924 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-31082056-4bb2-44e9-ac6f-fec7604cb14b tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:50.253381 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-31082056-4bb2-44e9-ac6f-fec7604cb14b tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:50.254149 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-31082056-4bb2-44e9-ac6f-fec7604cb14b tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:50.254592 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-31082056-4bb2-44e9-ac6f-fec7604cb14b tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:50.382183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-31082056-4bb2-44e9-ac6f-fec7604cb14b tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:50.389952 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-31082056-4bb2-44e9-ac6f-fec7604cb14b tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1575 microversion: 2.1 time: 0.148158 May 12 14:39:50.390518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 499/981] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:50 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:51.408701 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d628ea6f-a757-4776-8b34-970d09c7146d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:51.409400 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d628ea6f-a757-4776-8b34-970d09c7146d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:51.415529 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d628ea6f-a757-4776-8b34-970d09c7146d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:51.415981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d628ea6f-a757-4776-8b34-970d09c7146d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:51.416739 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d628ea6f-a757-4776-8b34-970d09c7146d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:51.417190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d628ea6f-a757-4776-8b34-970d09c7146d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:51.546823 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d628ea6f-a757-4776-8b34-970d09c7146d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:51.554125 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d628ea6f-a757-4776-8b34-970d09c7146d tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1575 microversion: 2.1 time: 0.150146 May 12 14:39:51.554685 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 483/982] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:51 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:52.572006 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7d328a30-b27d-43dc-ae51-cb7330180658 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:52.572630 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7d328a30-b27d-43dc-ae51-cb7330180658 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:39:52.579776 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7d328a30-b27d-43dc-ae51-cb7330180658 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:52.580241 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7d328a30-b27d-43dc-ae51-cb7330180658 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:52.581019 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7d328a30-b27d-43dc-ae51-cb7330180658 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:39:52.581466 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7d328a30-b27d-43dc-ae51-cb7330180658 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:39:52.707880 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7d328a30-b27d-43dc-ae51-cb7330180658 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:39:52.715167 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7d328a30-b27d-43dc-ae51-cb7330180658 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1562 microversion: 2.1 time: 0.147020 May 12 14:39:52.715743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 500/983] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:39:52 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:30.986600 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d02e9a22-b6f7-4842-a561-cba6cf7317e8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:30.987593 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d02e9a22-b6f7-4842-a561-cba6cf7317e8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:30.993986 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d02e9a22-b6f7-4842-a561-cba6cf7317e8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:30.994511 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d02e9a22-b6f7-4842-a561-cba6cf7317e8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:30.995854 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d02e9a22-b6f7-4842-a561-cba6cf7317e8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:30.996297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d02e9a22-b6f7-4842-a561-cba6cf7317e8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:31.065834 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d02e9a22-b6f7-4842-a561-cba6cf7317e8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "POST /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.083016 May 12 14:40:31.066457 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 484/984] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 12 14:40:30 2022] POST /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:40:31.074970 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-97afc8de-90f3-4fe2-a7df-7a364157722c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:31.075639 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-97afc8de-90f3-4fe2-a7df-7a364157722c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:31.082121 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97afc8de-90f3-4fe2-a7df-7a364157722c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:31.082586 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97afc8de-90f3-4fe2-a7df-7a364157722c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:31.083528 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97afc8de-90f3-4fe2-a7df-7a364157722c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:31.083972 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97afc8de-90f3-4fe2-a7df-7a364157722c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:31.317931 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-97afc8de-90f3-4fe2-a7df-7a364157722c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:31.326621 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-97afc8de-90f3-4fe2-a7df-7a364157722c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1749 microversion: 2.1 time: 0.255798 May 12 14:40:31.327217 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 501/985] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:31 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1749 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:32.345612 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d3d75476-de6a-4004-b537-fcb0c7d25ae8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:32.346342 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d3d75476-de6a-4004-b537-fcb0c7d25ae8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:32.352462 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d3d75476-de6a-4004-b537-fcb0c7d25ae8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:32.352909 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d3d75476-de6a-4004-b537-fcb0c7d25ae8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:32.353670 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d3d75476-de6a-4004-b537-fcb0c7d25ae8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:32.354132 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d3d75476-de6a-4004-b537-fcb0c7d25ae8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:32.496981 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d3d75476-de6a-4004-b537-fcb0c7d25ae8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:32.505182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d3d75476-de6a-4004-b537-fcb0c7d25ae8 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1754 microversion: 2.1 time: 0.164278 May 12 14:40:32.505752 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 485/986] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:32 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:33.523064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5ac9e389-7faa-4dbe-9b17-4e7481d7e6c7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:33.523691 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5ac9e389-7faa-4dbe-9b17-4e7481d7e6c7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:33.530224 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ac9e389-7faa-4dbe-9b17-4e7481d7e6c7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:33.530677 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ac9e389-7faa-4dbe-9b17-4e7481d7e6c7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:33.531473 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ac9e389-7faa-4dbe-9b17-4e7481d7e6c7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:33.531914 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ac9e389-7faa-4dbe-9b17-4e7481d7e6c7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:33.670481 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5ac9e389-7faa-4dbe-9b17-4e7481d7e6c7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:33.678106 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5ac9e389-7faa-4dbe-9b17-4e7481d7e6c7 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1754 microversion: 2.1 time: 0.158991 May 12 14:40:33.678665 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 502/987] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:33 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:34.695512 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c63d2907-4129-4257-9630-0b23b48de65c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:34.696154 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c63d2907-4129-4257-9630-0b23b48de65c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:34.703060 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c63d2907-4129-4257-9630-0b23b48de65c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:34.703517 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c63d2907-4129-4257-9630-0b23b48de65c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:34.704278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c63d2907-4129-4257-9630-0b23b48de65c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:34.704715 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c63d2907-4129-4257-9630-0b23b48de65c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:34.840932 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c63d2907-4129-4257-9630-0b23b48de65c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:34.848953 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c63d2907-4129-4257-9630-0b23b48de65c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1754 microversion: 2.1 time: 0.157226 May 12 14:40:34.849522 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 486/988] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:34 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:35.865588 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-aa17f5a4-95b5-48fc-bee7-3faa83184f64 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:35.866196 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-aa17f5a4-95b5-48fc-bee7-3faa83184f64 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:35.873268 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-aa17f5a4-95b5-48fc-bee7-3faa83184f64 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:35.873721 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-aa17f5a4-95b5-48fc-bee7-3faa83184f64 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:35.874486 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-aa17f5a4-95b5-48fc-bee7-3faa83184f64 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:35.874923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-aa17f5a4-95b5-48fc-bee7-3faa83184f64 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:36.021153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-aa17f5a4-95b5-48fc-bee7-3faa83184f64 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:36.028848 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-aa17f5a4-95b5-48fc-bee7-3faa83184f64 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1754 microversion: 2.1 time: 0.167094 May 12 14:40:36.029414 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 503/989] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:35 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:37.045982 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7db734fc-afd5-49be-bf5e-dccf4406f54a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:37.046625 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7db734fc-afd5-49be-bf5e-dccf4406f54a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:37.052982 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7db734fc-afd5-49be-bf5e-dccf4406f54a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:37.053430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7db734fc-afd5-49be-bf5e-dccf4406f54a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:37.054196 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7db734fc-afd5-49be-bf5e-dccf4406f54a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:37.054628 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7db734fc-afd5-49be-bf5e-dccf4406f54a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:37.190814 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7db734fc-afd5-49be-bf5e-dccf4406f54a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:37.199080 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7db734fc-afd5-49be-bf5e-dccf4406f54a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1754 microversion: 2.1 time: 0.156960 May 12 14:40:37.199650 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 487/990] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:37 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:38.149924 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-796161a1-cb6c-4593-9902-7d8d80eb2275 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:38.150429 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-796161a1-cb6c-4593-9902-7d8d80eb2275 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:38.157208 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-796161a1-cb6c-4593-9902-7d8d80eb2275 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:38.157662 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-796161a1-cb6c-4593-9902-7d8d80eb2275 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:38.158431 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-796161a1-cb6c-4593-9902-7d8d80eb2275 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:38.158874 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-796161a1-cb6c-4593-9902-7d8d80eb2275 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:38.216652 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7000c21f-0fb6-4312-a2d9-e07b71ca84d9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:38.217211 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7000c21f-0fb6-4312-a2d9-e07b71ca84d9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:38.223463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7000c21f-0fb6-4312-a2d9-e07b71ca84d9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:38.223918 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7000c21f-0fb6-4312-a2d9-e07b71ca84d9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:38.224693 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7000c21f-0fb6-4312-a2d9-e07b71ca84d9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:38.225134 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7000c21f-0fb6-4312-a2d9-e07b71ca84d9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:38.236793 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-796161a1-cb6c-4593-9902-7d8d80eb2275 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lazy-loading 'services' on Instance uuid 26e40740-6dab-4657-abc3-eb83ee4b4c4d {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:40:38.307432 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-796161a1-cb6c-4593-9902-7d8d80eb2275 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "DELETE /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-volume_attachments/c66f6872-c8ed-4315-a1e9-2f4fb21f982f" status: 202 len: 0 microversion: 2.1 time: 0.161254 May 12 14:40:38.308282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 504/991] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 12 14:40:38 2022] DELETE /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-volume_attachments/c66f6872-c8ed-4315-a1e9-2f4fb21f982f => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:40:38.316748 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e3f0cfbc-6d67-4cab-b506-55cba6d60ec3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:38.317891 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e3f0cfbc-6d67-4cab-b506-55cba6d60ec3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:38.324589 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e3f0cfbc-6d67-4cab-b506-55cba6d60ec3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:38.325050 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e3f0cfbc-6d67-4cab-b506-55cba6d60ec3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:38.325846 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e3f0cfbc-6d67-4cab-b506-55cba6d60ec3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:38.326295 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e3f0cfbc-6d67-4cab-b506-55cba6d60ec3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:38.356664 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e3f0cfbc-6d67-4cab-b506-55cba6d60ec3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 May 12 14:40:38.357258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 505/992] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:40:38 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:40:38.374342 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7000c21f-0fb6-4312-a2d9-e07b71ca84d9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:38.382221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7000c21f-0fb6-4312-a2d9-e07b71ca84d9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1754 microversion: 2.1 time: 0.169940 May 12 14:40:38.382780 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 488/993] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:38 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:39.370258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-674cdaca-83ef-413f-940e-ecb310337448 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:39.371239 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-674cdaca-83ef-413f-940e-ecb310337448 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:39.377514 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-674cdaca-83ef-413f-940e-ecb310337448 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:39.377976 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-674cdaca-83ef-413f-940e-ecb310337448 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:39.378757 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-674cdaca-83ef-413f-940e-ecb310337448 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:39.379239 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-674cdaca-83ef-413f-940e-ecb310337448 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:39.399524 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7de32581-5a2d-4e91-af74-60bd822357fd tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:39.400139 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7de32581-5a2d-4e91-af74-60bd822357fd tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:39.407392 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7de32581-5a2d-4e91-af74-60bd822357fd tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:39.407848 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7de32581-5a2d-4e91-af74-60bd822357fd tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:39.408167 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-674cdaca-83ef-413f-940e-ecb310337448 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042729 May 12 14:40:39.408684 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7de32581-5a2d-4e91-af74-60bd822357fd tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:39.412005 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 506/994] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:40:39 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:39.412145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7de32581-5a2d-4e91-af74-60bd822357fd tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:39.551367 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7de32581-5a2d-4e91-af74-60bd822357fd tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:39.559124 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7de32581-5a2d-4e91-af74-60bd822357fd tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1754 microversion: 2.1 time: 0.163438 May 12 14:40:39.559684 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 489/995] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:39 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:40:40.420310 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-28a6e646-6875-4146-af48-350192d1e3ed tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:40.421243 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-28a6e646-6875-4146-af48-350192d1e3ed tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:40.427555 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-28a6e646-6875-4146-af48-350192d1e3ed tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:40.428013 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-28a6e646-6875-4146-af48-350192d1e3ed tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:40.428789 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-28a6e646-6875-4146-af48-350192d1e3ed tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:40.429231 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-28a6e646-6875-4146-af48-350192d1e3ed tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:40.458705 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-28a6e646-6875-4146-af48-350192d1e3ed tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043901 May 12 14:40:40.459298 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 507/996] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:40:40 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:40:40.545280 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e688cce0-6bd0-4b85-9597-65a14350ad70 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:40.545825 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e688cce0-6bd0-4b85-9597-65a14350ad70 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:40.552129 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e688cce0-6bd0-4b85-9597-65a14350ad70 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:40.552581 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e688cce0-6bd0-4b85-9597-65a14350ad70 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:40.553343 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e688cce0-6bd0-4b85-9597-65a14350ad70 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:40.553776 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e688cce0-6bd0-4b85-9597-65a14350ad70 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:40.576493 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-6e5d6168-771f-45dd-8603-930affc1c1ba tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:40.577113 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-6e5d6168-771f-45dd-8603-930affc1c1ba tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:40.579994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e688cce0-6bd0-4b85-9597-65a14350ad70 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Going to try to terminate instance {{(pid=118216) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:40:40.582851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6e5d6168-771f-45dd-8603-930affc1c1ba tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:40.583333 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6e5d6168-771f-45dd-8603-930affc1c1ba tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:40.584093 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6e5d6168-771f-45dd-8603-930affc1c1ba tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:40.584531 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6e5d6168-771f-45dd-8603-930affc1c1ba tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:40.733025 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-6e5d6168-771f-45dd-8603-930affc1c1ba tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:40.741196 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-6e5d6168-771f-45dd-8603-930affc1c1ba tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1754 microversion: 2.1 time: 0.168974 May 12 14:40:40.741946 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 508/997] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:40 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:40:40.814010 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e688cce0-6bd0-4b85-9597-65a14350ad70 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "DELETE /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 204 len: 0 microversion: 2.1 time: 0.272166 May 12 14:40:40.814662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 490/998] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:40:40 2022] DELETE /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:40:40.823358 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c5f201a2-57b9-47d4-85d5-b27b2627aa40 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:40.823980 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c5f201a2-57b9-47d4-85d5-b27b2627aa40 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:40.830147 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c5f201a2-57b9-47d4-85d5-b27b2627aa40 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:40.830606 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c5f201a2-57b9-47d4-85d5-b27b2627aa40 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:40.831428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c5f201a2-57b9-47d4-85d5-b27b2627aa40 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:40.831872 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c5f201a2-57b9-47d4-85d5-b27b2627aa40 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:40.961419 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c5f201a2-57b9-47d4-85d5-b27b2627aa40 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:40.968842 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c5f201a2-57b9-47d4-85d5-b27b2627aa40 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1689 microversion: 2.1 time: 0.149935 May 12 14:40:40.969398 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 509/999] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:40 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:41.759430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6294f45b-ad7b-40fc-b9bb-48b8641b8a1b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:41.760160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6294f45b-ad7b-40fc-b9bb-48b8641b8a1b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:41.766259 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6294f45b-ad7b-40fc-b9bb-48b8641b8a1b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:41.766704 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6294f45b-ad7b-40fc-b9bb-48b8641b8a1b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:41.767498 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6294f45b-ad7b-40fc-b9bb-48b8641b8a1b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:41.767936 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6294f45b-ad7b-40fc-b9bb-48b8641b8a1b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:41.904238 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6294f45b-ad7b-40fc-b9bb-48b8641b8a1b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:41.911837 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6294f45b-ad7b-40fc-b9bb-48b8641b8a1b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1754 microversion: 2.1 time: 0.156735 May 12 14:40:41.912425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 491/1000] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:41 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:41.987061 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c8cb3dc4-3e21-4404-9310-d657741c5154 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:41.987911 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c8cb3dc4-3e21-4404-9310-d657741c5154 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:41.995057 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c8cb3dc4-3e21-4404-9310-d657741c5154 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:41.995519 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c8cb3dc4-3e21-4404-9310-d657741c5154 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:41.996285 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c8cb3dc4-3e21-4404-9310-d657741c5154 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:41.996724 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c8cb3dc4-3e21-4404-9310-d657741c5154 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:42.124166 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c8cb3dc4-3e21-4404-9310-d657741c5154 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:42.131432 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c8cb3dc4-3e21-4404-9310-d657741c5154 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1689 microversion: 2.1 time: 0.148703 May 12 14:40:42.131995 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 510/1001] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:41 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:42.928875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-fde323e9-65e6-4ac6-9a1a-87957f18368c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:42.929483 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-fde323e9-65e6-4ac6-9a1a-87957f18368c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:42.936399 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fde323e9-65e6-4ac6-9a1a-87957f18368c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:42.936849 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fde323e9-65e6-4ac6-9a1a-87957f18368c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:42.937623 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fde323e9-65e6-4ac6-9a1a-87957f18368c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:42.938056 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-fde323e9-65e6-4ac6-9a1a-87957f18368c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:43.089737 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-fde323e9-65e6-4ac6-9a1a-87957f18368c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:43.097470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-fde323e9-65e6-4ac6-9a1a-87957f18368c tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1754 microversion: 2.1 time: 0.172427 May 12 14:40:43.098029 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 492/1002] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:42 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:43.148658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-43d6fbf8-6d06-45c9-918b-6bf2077fd6c3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:43.149280 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-43d6fbf8-6d06-45c9-918b-6bf2077fd6c3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:43.156168 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-43d6fbf8-6d06-45c9-918b-6bf2077fd6c3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:43.156625 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-43d6fbf8-6d06-45c9-918b-6bf2077fd6c3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:43.157401 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-43d6fbf8-6d06-45c9-918b-6bf2077fd6c3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:43.157847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-43d6fbf8-6d06-45c9-918b-6bf2077fd6c3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:43.281542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-43d6fbf8-6d06-45c9-918b-6bf2077fd6c3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:43.288842 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-43d6fbf8-6d06-45c9-918b-6bf2077fd6c3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1689 microversion: 2.1 time: 0.144132 May 12 14:40:43.289410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 511/1003] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:43 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1689 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:44.115517 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1a0f7f9c-59bb-4c14-bb7a-a82c1ee67621 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:44.116265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1a0f7f9c-59bb-4c14-bb7a-a82c1ee67621 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:44.123605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1a0f7f9c-59bb-4c14-bb7a-a82c1ee67621 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:44.124061 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1a0f7f9c-59bb-4c14-bb7a-a82c1ee67621 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:44.124836 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1a0f7f9c-59bb-4c14-bb7a-a82c1ee67621 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:44.125280 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1a0f7f9c-59bb-4c14-bb7a-a82c1ee67621 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:44.265301 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1a0f7f9c-59bb-4c14-bb7a-a82c1ee67621 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:44.273240 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1a0f7f9c-59bb-4c14-bb7a-a82c1ee67621 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1754 microversion: 2.1 time: 0.162240 May 12 14:40:44.273798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 493/1004] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:44 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:44.285057 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8525a4ff-bb84-4d07-8456-81f2a3855671 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:44.285598 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8525a4ff-bb84-4d07-8456-81f2a3855671 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:44.291824 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8525a4ff-bb84-4d07-8456-81f2a3855671 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:44.292281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8525a4ff-bb84-4d07-8456-81f2a3855671 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:44.293055 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8525a4ff-bb84-4d07-8456-81f2a3855671 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:44.293497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8525a4ff-bb84-4d07-8456-81f2a3855671 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:44.305758 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-311b4900-756a-443b-b080-e8baadcb4384 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:44.306367 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-311b4900-756a-443b-b080-e8baadcb4384 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:44.312184 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-311b4900-756a-443b-b080-e8baadcb4384 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:44.312641 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-311b4900-756a-443b-b080-e8baadcb4384 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:44.313422 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-311b4900-756a-443b-b080-e8baadcb4384 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:44.313870 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-311b4900-756a-443b-b080-e8baadcb4384 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:44.315938 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8525a4ff-bb84-4d07-8456-81f2a3855671 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802/ips" status: 200 len: 149 microversion: 2.1 time: 0.034701 May 12 14:40:44.316716 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 512/1005] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 12 14:40:44 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:44.456125 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-311b4900-756a-443b-b080-e8baadcb4384 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:44.463652 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-311b4900-756a-443b-b080-e8baadcb4384 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1689 microversion: 2.1 time: 0.161732 May 12 14:40:44.464224 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 494/1006] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:44 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:45.290864 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-042a9c6d-8a7a-4d3a-8be4-38b536680807 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:45.291942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-042a9c6d-8a7a-4d3a-8be4-38b536680807 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:45.298166 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-042a9c6d-8a7a-4d3a-8be4-38b536680807 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:45.298618 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-042a9c6d-8a7a-4d3a-8be4-38b536680807 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:45.299411 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-042a9c6d-8a7a-4d3a-8be4-38b536680807 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:45.299847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-042a9c6d-8a7a-4d3a-8be4-38b536680807 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:45.443515 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-042a9c6d-8a7a-4d3a-8be4-38b536680807 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:45.452232 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-042a9c6d-8a7a-4d3a-8be4-38b536680807 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1754 microversion: 2.1 time: 0.164382 May 12 14:40:45.452232 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 513/1007] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:45 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:45.482420 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-bf76a73c-9bbb-4425-9357-41c0daddfb10 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:45.483367 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-bf76a73c-9bbb-4425-9357-41c0daddfb10 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:45.489865 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bf76a73c-9bbb-4425-9357-41c0daddfb10 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:45.490517 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bf76a73c-9bbb-4425-9357-41c0daddfb10 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:45.491328 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bf76a73c-9bbb-4425-9357-41c0daddfb10 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:45.491766 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-bf76a73c-9bbb-4425-9357-41c0daddfb10 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:45.620111 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-bf76a73c-9bbb-4425-9357-41c0daddfb10 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:45.627996 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-bf76a73c-9bbb-4425-9357-41c0daddfb10 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1689 microversion: 2.1 time: 0.150023 May 12 14:40:45.628905 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 495/1008] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:45 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:45.663792 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1882315b-3143-4ef6-8ab2-aac42378938d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e71477fa-f927-45a3-9dab-57a09d707d65"}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:45.665000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1882315b-3143-4ef6-8ab2-aac42378938d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:45.671828 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1882315b-3143-4ef6-8ab2-aac42378938d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:45.672285 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1882315b-3143-4ef6-8ab2-aac42378938d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:45.673114 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1882315b-3143-4ef6-8ab2-aac42378938d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:45.673548 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1882315b-3143-4ef6-8ab2-aac42378938d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:46.190685 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1882315b-3143-4ef6-8ab2-aac42378938d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "POST /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.530579 May 12 14:40:46.191628 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 514/1009] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 12 14:40:45 2022] POST /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802/os-volume_attachments => generated 194 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:46.468716 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-49a497c7-66d6-4ff7-98f1-4bd99d05c9e0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:46.469335 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-49a497c7-66d6-4ff7-98f1-4bd99d05c9e0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:46.475254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-49a497c7-66d6-4ff7-98f1-4bd99d05c9e0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:46.475736 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-49a497c7-66d6-4ff7-98f1-4bd99d05c9e0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:46.476511 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-49a497c7-66d6-4ff7-98f1-4bd99d05c9e0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:46.476951 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-49a497c7-66d6-4ff7-98f1-4bd99d05c9e0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:46.646125 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e2a3d20d-355f-4767-8881-050b332ff47b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:46.646769 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e2a3d20d-355f-4767-8881-050b332ff47b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:46.653284 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e2a3d20d-355f-4767-8881-050b332ff47b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:46.653747 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e2a3d20d-355f-4767-8881-050b332ff47b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:46.654534 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e2a3d20d-355f-4767-8881-050b332ff47b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:46.654979 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e2a3d20d-355f-4767-8881-050b332ff47b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:46.737704 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e2a3d20d-355f-4767-8881-050b332ff47b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:46.745978 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e2a3d20d-355f-4767-8881-050b332ff47b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1622 microversion: 2.1 time: 0.104152 May 12 14:40:46.746571 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 515/1010] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:46 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1622 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:40:46.768967 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-49a497c7-66d6-4ff7-98f1-4bd99d05c9e0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:46.777761 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-49a497c7-66d6-4ff7-98f1-4bd99d05c9e0 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1757 microversion: 2.1 time: 0.312963 May 12 14:40:46.778325 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 496/1011] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:46 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1757 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:46.942087 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-3f7acf3b-e18a-4ec6-9f5b-e68bf81e9d41 req-547c7563-204c-4f7f-947d-33daac313072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e40740-6dab-4657-abc3-eb83ee4b4c4d", "name": "network-vif-deleted", "tag": "1d9bd042-8dc9-4559-9211-62f3a465dca4"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:46.951918 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-3f7acf3b-e18a-4ec6-9f5b-e68bf81e9d41 req-547c7563-204c-4f7f-947d-33daac313072 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:46.952325 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-3f7acf3b-e18a-4ec6-9f5b-e68bf81e9d41 req-547c7563-204c-4f7f-947d-33daac313072 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:46.963784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-3f7acf3b-e18a-4ec6-9f5b-e68bf81e9d41 req-547c7563-204c-4f7f-947d-33daac313072 service nova] Creating event network-vif-deleted:1d9bd042-8dc9-4559-9211-62f3a465dca4 for instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d on hv-cinder-77703 May 12 14:40:46.968826 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-3f7acf3b-e18a-4ec6-9f5b-e68bf81e9d41 req-547c7563-204c-4f7f-947d-33daac313072 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031322 May 12 14:40:46.969441 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 516/1012] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:47.763354 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-84383f81-b4cf-412b-b653-a36553ff2b99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:47.763992 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-84383f81-b4cf-412b-b653-a36553ff2b99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:47.770473 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84383f81-b4cf-412b-b653-a36553ff2b99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:47.771138 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84383f81-b4cf-412b-b653-a36553ff2b99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:47.771729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84383f81-b4cf-412b-b653-a36553ff2b99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:47.772164 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84383f81-b4cf-412b-b653-a36553ff2b99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:47.804532 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84383f81-b4cf-412b-b653-a36553ff2b99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:47.805035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-84383f81-b4cf-412b-b653-a36553ff2b99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:47.805469 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-84383f81-b4cf-412b-b653-a36553ff2b99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lazy-loading 'fault' on Instance uuid 26e40740-6dab-4657-abc3-eb83ee4b4c4d {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:40:47.847523 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-84383f81-b4cf-412b-b653-a36553ff2b99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:47.855341 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-84383f81-b4cf-412b-b653-a36553ff2b99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 200 len: 1336 microversion: 2.1 time: 0.096451 May 12 14:40:47.855985 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 497/1013] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:47 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 1336 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:48.873886 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a58f807e-6bfb-4ac8-98aa-ee28f6e32225 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:48.874597 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a58f807e-6bfb-4ac8-98aa-ee28f6e32225 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 26e40740-6dab-4657-abc3-eb83ee4b4c4d] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:48.880699 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a58f807e-6bfb-4ac8-98aa-ee28f6e32225 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:48.881163 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a58f807e-6bfb-4ac8-98aa-ee28f6e32225 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:48.881954 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a58f807e-6bfb-4ac8-98aa-ee28f6e32225 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:48.882401 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a58f807e-6bfb-4ac8-98aa-ee28f6e32225 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:48.895497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-a58f807e-6bfb-4ac8-98aa-ee28f6e32225 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] HTTP exception thrown: Instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d could not be found. May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a58f807e-6bfb-4ac8-98aa-ee28f6e32225 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Request method failure captured: May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d HTTP/1.1 May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRq0uWuP3TVHlLteeytECkdY1IHk4Hm4jgv2EqCnNnd6d7UG3PWB-NuAqkTLkf0WOJPkE44_BXmJ11jpUpyyW5sLjohov-DKwiXHfMHAMPjixk4n1DyvIkCubo7puSPwFp_XC3lYOHR3XN9hdOa8f44jvM5ppqXDZozdTAyrt_DDmpY May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 3c83c8fa2cd44eab84cb50b3ad06a1d3 May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1594015429 May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:40:48.897153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:40:48.898832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3c83c8fa2cd44eab84cb50b3ad06a1d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c83c8fa2cd44eab84cb50b3ad06a1d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3c83c8fa2cd44eab84cb50b3ad06a1d3", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c83c8fa2cd44eab84cb50b3ad06a1d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:40:48.898832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1594015429 May 12 14:40:48.898832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 3c83c8fa2cd44eab84cb50b3ad06a1d3 May 12 14:40:48.898832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1594015429 May 12 14:40:48.898832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-ServerRescueNegativeTestJSON-1594015429-project May 12 14:40:48.898832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:40:48.898832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:40:48.898832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: 2cfa47f1da4e4ae9a358e2b8ace795ac May 12 14:40:48.898832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1594015429-project May 12 14:40:48.898832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:40:48.898832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d could not be found. May 12 14:40:48.898832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': '26e40740-6dab-4657-abc3-eb83ee4b4c4d'} May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d could not be found. May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:40:48.899948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d could not be found. May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d could not be found. May 12 14:40:48.901319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:40:48.902660 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a58f807e-6bfb-4ac8-98aa-ee28f6e32225 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Returning 404 to user: Instance 26e40740-6dab-4657-abc3-eb83ee4b4c4d could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:40:48.902660 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a58f807e-6bfb-4ac8-98aa-ee28f6e32225 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d" status: 404 len: 111 microversion: 2.1 time: 0.029946 May 12 14:40:48.902660 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 517/1014] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:48 2022] GET /compute/v2.1/servers/26e40740-6dab-4657-abc3-eb83ee4b4c4d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:40:48.908471 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8e6d56da-0b0c-44a1-abdd-ac925618a2e5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '.version_select at 0x7f5b2601eaf0>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:48.928752 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8e6d56da-0b0c-44a1-abdd-ac925618a2e5 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024683558" status: 202 len: 0 microversion: 2.1 time: 0.024705 May 12 14:40:48.929329 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 498/1015] 10.222.0.75 () {58 vars in 1220 bytes} [Thu May 12 14:40:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024683558 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:40:49.467284 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-34db83e9-a06f-44bc-98ef-b643b183f2fe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e71477fa-f927-45a3-9dab-57a09d707d65"}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:49.468483 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-34db83e9-a06f-44bc-98ef-b643b183f2fe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:49.474883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-34db83e9-a06f-44bc-98ef-b643b183f2fe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:49.475409 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-34db83e9-a06f-44bc-98ef-b643b183f2fe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:49.476194 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-34db83e9-a06f-44bc-98ef-b643b183f2fe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:49.476720 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-34db83e9-a06f-44bc-98ef-b643b183f2fe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:49.561708 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-34db83e9-a06f-44bc-98ef-b643b183f2fe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] HTTP exception thrown: Invalid volume: volume e71477fa-f927-45a3-9dab-57a09d707d65 is already attached to instances: 134a856e-1321-471c-bc31-43307ca41802 May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-34db83e9-a06f-44bc-98ef-b643b183f2fe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Request method failure captured: May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: POST /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802/os-volume_attachments HTTP/1.1 May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 74 May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRo-ycWfHqPPxbmLiuTXrtXJLZwYU78oTuGhPDkiQSHU7CKcy_GQqpZ_HWFwpOkfP_a2cy2OZwfawJtQIkHx1tZyLxJZoQOwjSpujcF6pQ0BcV3O7kKLbSCm6-7BGei9mU5XP-t1FCFU5rK_O_aRKcjHsdbD5yR-8mP9_YNetCjLQkw May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:40:49.563410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:40:49.565169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4b5ca018b5f4dda99486407424b8168", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:40:49.565169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-AttachVolumeNegativeTest-523912070 May 12 14:40:49.565169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:40:49.565169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:40:49.565169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:40:49.565169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:40:49.565169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:40:49.565169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: c6422873a3b84aac88f8a93291bcd7b0 May 12 14:40:49.565169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:40:49.565169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: May 12 14:40:49.565169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {"volumeAttachment": {"volumeId": "e71477fa-f927-45a3-9dab-57a09d707d65"}} May 12 14:40:49.565169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Invalid volume: volume e71477fa-f927-45a3-9dab-57a09d707d65 is already attached to instances: 134a856e-1321-471c-bc31-43307ca41802 May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'server_id': '134a856e-1321-471c-bc31-43307ca41802', 'body': {'volumeAttachment': {'volumeId': 'e71477fa-f927-45a3-9dab-57a09d707d65'}}} May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e71477fa-f927-45a3-9dab-57a09d707d65 is already attached to instances: 134a856e-1321-471c-bc31-43307ca41802 May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:40:49.566234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e71477fa-f927-45a3-9dab-57a09d707d65 is already attached to instances: 134a856e-1321-471c-bc31-43307ca41802 May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:40:49.567743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:40:49.569324 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:40:49.569324 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:40:49.569324 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:40:49.569324 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e71477fa-f927-45a3-9dab-57a09d707d65 is already attached to instances: 134a856e-1321-471c-bc31-43307ca41802 May 12 14:40:49.569324 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:40:49.569324 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-34db83e9-a06f-44bc-98ef-b643b183f2fe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Returning 400 to user: Invalid volume: volume e71477fa-f927-45a3-9dab-57a09d707d65 is already attached to instances: 134a856e-1321-471c-bc31-43307ca41802 {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:40:49.569324 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-34db83e9-a06f-44bc-98ef-b643b183f2fe tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "POST /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102328 May 12 14:40:49.569324 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 518/1016] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 12 14:40:49 2022] POST /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 12 14:40:49.627721 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6a2f516f-ce8a-4a27-bf39-5aea0f0a925c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:49.628207 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6a2f516f-ce8a-4a27-bf39-5aea0f0a925c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:49.634038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6a2f516f-ce8a-4a27-bf39-5aea0f0a925c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:49.634495 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6a2f516f-ce8a-4a27-bf39-5aea0f0a925c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:49.635805 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6a2f516f-ce8a-4a27-bf39-5aea0f0a925c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:49.636247 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6a2f516f-ce8a-4a27-bf39-5aea0f0a925c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:49.714427 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-6a2f516f-ce8a-4a27-bf39-5aea0f0a925c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lazy-loading 'services' on Instance uuid 134a856e-1321-471c-bc31-43307ca41802 {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:40:49.785477 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6a2f516f-ce8a-4a27-bf39-5aea0f0a925c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802/os-volume_attachments/e71477fa-f927-45a3-9dab-57a09d707d65" status: 202 len: 0 microversion: 2.1 time: 0.161714 May 12 14:40:49.787832 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 499/1017] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 12 14:40:49 2022] DELETE /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802/os-volume_attachments/e71477fa-f927-45a3-9dab-57a09d707d65 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:40:49.795928 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8487c1c7-7b0c-4d9f-a9ab-d48921d0b94c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:49.797352 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8487c1c7-7b0c-4d9f-a9ab-d48921d0b94c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:49.804251 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8487c1c7-7b0c-4d9f-a9ab-d48921d0b94c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:49.804729 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8487c1c7-7b0c-4d9f-a9ab-d48921d0b94c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:49.805487 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8487c1c7-7b0c-4d9f-a9ab-d48921d0b94c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:49.805936 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8487c1c7-7b0c-4d9f-a9ab-d48921d0b94c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:49.835314 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8487c1c7-7b0c-4d9f-a9ab-d48921d0b94c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043404 May 12 14:40:49.835885 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 519/1018] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:40:49 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:50.849025 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d03c4cd6-c584-4336-9399-398370f349a3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:50.850095 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d03c4cd6-c584-4336-9399-398370f349a3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:50.858434 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d03c4cd6-c584-4336-9399-398370f349a3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:50.858882 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d03c4cd6-c584-4336-9399-398370f349a3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:50.859788 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d03c4cd6-c584-4336-9399-398370f349a3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:50.860313 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d03c4cd6-c584-4336-9399-398370f349a3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:50.891004 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d03c4cd6-c584-4336-9399-398370f349a3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047102 May 12 14:40:50.891617 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 500/1019] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:40:50 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:40:50.948685 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-941f7ac3-f5ca-43c1-ac3d-1150f279d8b1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:50.949213 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-941f7ac3-f5ca-43c1-ac3d-1150f279d8b1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:50.955414 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-941f7ac3-f5ca-43c1-ac3d-1150f279d8b1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:50.955881 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-941f7ac3-f5ca-43c1-ac3d-1150f279d8b1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:50.956656 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-941f7ac3-f5ca-43c1-ac3d-1150f279d8b1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:50.957103 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-941f7ac3-f5ca-43c1-ac3d-1150f279d8b1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:50.982616 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-941f7ac3-f5ca-43c1-ac3d-1150f279d8b1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Going to try to terminate instance {{(pid=118217) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:40:51.055920 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-941f7ac3-f5ca-43c1-ac3d-1150f279d8b1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 204 len: 0 microversion: 2.1 time: 0.110831 May 12 14:40:51.056514 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 520/1020] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:40:50 2022] DELETE /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:40:51.064995 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2bb84c18-1791-45d0-bd3a-ab9b6b5abfa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:51.065550 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2bb84c18-1791-45d0-bd3a-ab9b6b5abfa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:51.071301 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2bb84c18-1791-45d0-bd3a-ab9b6b5abfa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:51.071754 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2bb84c18-1791-45d0-bd3a-ab9b6b5abfa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:51.072529 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2bb84c18-1791-45d0-bd3a-ab9b6b5abfa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:51.073504 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2bb84c18-1791-45d0-bd3a-ab9b6b5abfa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:51.202987 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2bb84c18-1791-45d0-bd3a-ab9b6b5abfa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:51.210312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2bb84c18-1791-45d0-bd3a-ab9b6b5abfa3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1681 microversion: 2.1 time: 0.149404 May 12 14:40:51.210882 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 501/1021] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:51 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:51.772173 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a79b9243-5781-4e2f-abb1-83d3c77ea6d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:51.772757 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a79b9243-5781-4e2f-abb1-83d3c77ea6d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:51.778571 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a79b9243-5781-4e2f-abb1-83d3c77ea6d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:51.779022 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a79b9243-5781-4e2f-abb1-83d3c77ea6d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:51.779810 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a79b9243-5781-4e2f-abb1-83d3c77ea6d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:51.780246 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a79b9243-5781-4e2f-abb1-83d3c77ea6d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:51.804566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a79b9243-5781-4e2f-abb1-83d3c77ea6d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Going to try to terminate instance {{(pid=118217) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:40:51.878208 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a79b9243-5781-4e2f-abb1-83d3c77ea6d8 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "DELETE /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 204 len: 0 microversion: 2.1 time: 0.109807 May 12 14:40:51.878792 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 521/1022] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:40:51 2022] DELETE /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:40:51.886567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-cca94ec7-7c57-4e4e-982a-cc16d8ad954f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:51.887207 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-cca94ec7-7c57-4e4e-982a-cc16d8ad954f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:51.893358 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cca94ec7-7c57-4e4e-982a-cc16d8ad954f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:51.893811 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cca94ec7-7c57-4e4e-982a-cc16d8ad954f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:51.894574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cca94ec7-7c57-4e4e-982a-cc16d8ad954f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:51.895015 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cca94ec7-7c57-4e4e-982a-cc16d8ad954f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:52.022682 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-cca94ec7-7c57-4e4e-982a-cc16d8ad954f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:52.024785 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2941f1c8-82e4-4932-a93c-2bd0b0ed7eca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:52.025816 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2941f1c8-82e4-4932-a93c-2bd0b0ed7eca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:52.030928 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-cca94ec7-7c57-4e4e-982a-cc16d8ad954f tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1508 microversion: 2.1 time: 0.148139 May 12 14:40:52.031529 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 502/1023] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:51 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:52.032771 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2941f1c8-82e4-4932-a93c-2bd0b0ed7eca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:52.033238 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2941f1c8-82e4-4932-a93c-2bd0b0ed7eca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:52.034022 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2941f1c8-82e4-4932-a93c-2bd0b0ed7eca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:52.034462 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2941f1c8-82e4-4932-a93c-2bd0b0ed7eca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:52.059677 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2941f1c8-82e4-4932-a93c-2bd0b0ed7eca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322/ips" status: 200 len: 152 microversion: 2.20 time: 0.039175 May 12 14:40:52.060255 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 522/1024] 10.222.0.75 () {60 vars in 1288 bytes} [Thu May 12 14:40:52 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:40:52.234795 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6a1b1cff-d79b-4db0-a6d9-b01fe8a78550 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:52.235446 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6a1b1cff-d79b-4db0-a6d9-b01fe8a78550 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:52.241952 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6a1b1cff-d79b-4db0-a6d9-b01fe8a78550 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:52.242443 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6a1b1cff-d79b-4db0-a6d9-b01fe8a78550 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:52.243728 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6a1b1cff-d79b-4db0-a6d9-b01fe8a78550 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:52.244198 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6a1b1cff-d79b-4db0-a6d9-b01fe8a78550 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:52.379091 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6a1b1cff-d79b-4db0-a6d9-b01fe8a78550 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:52.386769 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6a1b1cff-d79b-4db0-a6d9-b01fe8a78550 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1681 microversion: 2.1 time: 0.156077 May 12 14:40:52.387372 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 503/1025] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:52 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:53.048344 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-82c3fc05-00ce-44ec-9ac4-faf851113966 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:53.048970 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-82c3fc05-00ce-44ec-9ac4-faf851113966 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:53.055263 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-82c3fc05-00ce-44ec-9ac4-faf851113966 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:53.055726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-82c3fc05-00ce-44ec-9ac4-faf851113966 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:53.056503 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-82c3fc05-00ce-44ec-9ac4-faf851113966 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:53.056957 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-82c3fc05-00ce-44ec-9ac4-faf851113966 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:53.182837 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-82c3fc05-00ce-44ec-9ac4-faf851113966 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:53.190123 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-82c3fc05-00ce-44ec-9ac4-faf851113966 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1508 microversion: 2.1 time: 0.145706 May 12 14:40:53.190696 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 523/1026] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:53 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:53.404276 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e4ad0900-af8d-4796-a662-3811282afc51 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:53.404892 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e4ad0900-af8d-4796-a662-3811282afc51 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:53.411328 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e4ad0900-af8d-4796-a662-3811282afc51 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:53.411785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e4ad0900-af8d-4796-a662-3811282afc51 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:53.412559 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e4ad0900-af8d-4796-a662-3811282afc51 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:53.413003 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e4ad0900-af8d-4796-a662-3811282afc51 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:53.538126 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e4ad0900-af8d-4796-a662-3811282afc51 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:53.545380 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e4ad0900-af8d-4796-a662-3811282afc51 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1681 microversion: 2.1 time: 0.145572 May 12 14:40:53.545948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 504/1027] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:53 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:54.206971 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d7eb8325-70ff-425a-9e59-278fbb82b38e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:54.207633 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d7eb8325-70ff-425a-9e59-278fbb82b38e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:54.214553 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d7eb8325-70ff-425a-9e59-278fbb82b38e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:54.215017 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d7eb8325-70ff-425a-9e59-278fbb82b38e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:54.215829 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d7eb8325-70ff-425a-9e59-278fbb82b38e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:54.216278 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d7eb8325-70ff-425a-9e59-278fbb82b38e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:54.296437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a7e25617-f5f2-4f0d-a3ea-7bd68e99f891 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:54.297062 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a7e25617-f5f2-4f0d-a3ea-7bd68e99f891 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:54.302867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a7e25617-f5f2-4f0d-a3ea-7bd68e99f891 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:54.303351 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a7e25617-f5f2-4f0d-a3ea-7bd68e99f891 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:54.304131 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a7e25617-f5f2-4f0d-a3ea-7bd68e99f891 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:54.304569 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a7e25617-f5f2-4f0d-a3ea-7bd68e99f891 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:54.327095 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-a7e25617-f5f2-4f0d-a3ea-7bd68e99f891 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lazy-loading 'flavor' on Instance uuid 533a547e-b44f-4a33-8725-24b323556322 {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:40:54.478539 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d7eb8325-70ff-425a-9e59-278fbb82b38e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:54.487732 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d7eb8325-70ff-425a-9e59-278fbb82b38e tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1508 microversion: 2.1 time: 0.284423 May 12 14:40:54.488340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 524/1028] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:54 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:54.565154 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0fac5a35-7980-41a4-8652-b27ce3b231aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:54.566579 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0fac5a35-7980-41a4-8652-b27ce3b231aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:54.574243 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0fac5a35-7980-41a4-8652-b27ce3b231aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:54.575212 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0fac5a35-7980-41a4-8652-b27ce3b231aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:54.576309 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0fac5a35-7980-41a4-8652-b27ce3b231aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:54.577249 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0fac5a35-7980-41a4-8652-b27ce3b231aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:54.609839 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a7e25617-f5f2-4f0d-a3ea-7bd68e99f891 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "POST /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322/action" status: 202 len: 0 microversion: 2.20 time: 0.317077 May 12 14:40:54.611842 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 505/1029] 10.222.0.75 () {62 vars in 1318 bytes} [Thu May 12 14:40:54 2022] POST /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 12 14:40:54.623300 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4aaf08bc-b689-42ef-99c0-9cee1146ffb0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:54.624316 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4aaf08bc-b689-42ef-99c0-9cee1146ffb0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:54.632709 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4aaf08bc-b689-42ef-99c0-9cee1146ffb0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:54.633179 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4aaf08bc-b689-42ef-99c0-9cee1146ffb0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:54.634368 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4aaf08bc-b689-42ef-99c0-9cee1146ffb0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:54.635092 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4aaf08bc-b689-42ef-99c0-9cee1146ffb0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:55.123971 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0fac5a35-7980-41a4-8652-b27ce3b231aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:55.131380 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0fac5a35-7980-41a4-8652-b27ce3b231aa tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1681 microversion: 2.1 time: 0.573008 May 12 14:40:55.132367 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 525/1030] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:54 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1681 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:55.136760 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4aaf08bc-b689-42ef-99c0-9cee1146ffb0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:55.145405 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4aaf08bc-b689-42ef-99c0-9cee1146ffb0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:55.146843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4aaf08bc-b689-42ef-99c0-9cee1146ffb0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:55.148051 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4aaf08bc-b689-42ef-99c0-9cee1146ffb0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.530778 May 12 14:40:55.148717 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 506/1031] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:40:54 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:40:55.269187 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-646e610b-9c95-409c-91a2-3612f380917a req-88f4626d-424d-4e96-b36f-224510f97361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137403bd-302f-4ea4-aeba-782ade2358e0", "name": "network-vif-deleted", "tag": "edce530e-0a2a-4073-b478-f2228ceb37bc"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:55.279878 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-646e610b-9c95-409c-91a2-3612f380917a req-88f4626d-424d-4e96-b36f-224510f97361 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:55.280333 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-646e610b-9c95-409c-91a2-3612f380917a req-88f4626d-424d-4e96-b36f-224510f97361 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:55.292198 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-646e610b-9c95-409c-91a2-3612f380917a req-88f4626d-424d-4e96-b36f-224510f97361 service nova] Creating event network-vif-deleted:edce530e-0a2a-4073-b478-f2228ceb37bc for instance 137403bd-302f-4ea4-aeba-782ade2358e0 on hv-cinder-77703 May 12 14:40:55.297127 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-646e610b-9c95-409c-91a2-3612f380917a req-88f4626d-424d-4e96-b36f-224510f97361 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033159 May 12 14:40:55.297722 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 526/1032] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:55.505519 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-80bbd2ce-d4c1-4a75-bfcf-7b202e1f7d99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:55.506197 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-80bbd2ce-d4c1-4a75-bfcf-7b202e1f7d99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:55.513133 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-80bbd2ce-d4c1-4a75-bfcf-7b202e1f7d99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:55.513652 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-80bbd2ce-d4c1-4a75-bfcf-7b202e1f7d99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:55.514484 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-80bbd2ce-d4c1-4a75-bfcf-7b202e1f7d99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:55.514987 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-80bbd2ce-d4c1-4a75-bfcf-7b202e1f7d99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:55.616604 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-80bbd2ce-d4c1-4a75-bfcf-7b202e1f7d99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:55.625947 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-80bbd2ce-d4c1-4a75-bfcf-7b202e1f7d99 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1466 microversion: 2.1 time: 0.123976 May 12 14:40:55.627489 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 507/1033] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:55 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1466 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:56.149616 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b5dd47f4-f0b7-4e56-9b5c-c909d9fe84a7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:56.150318 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b5dd47f4-f0b7-4e56-9b5c-c909d9fe84a7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:56.156962 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b5dd47f4-f0b7-4e56-9b5c-c909d9fe84a7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:56.157415 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b5dd47f4-f0b7-4e56-9b5c-c909d9fe84a7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:56.158181 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b5dd47f4-f0b7-4e56-9b5c-c909d9fe84a7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:56.158618 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b5dd47f4-f0b7-4e56-9b5c-c909d9fe84a7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:56.166239 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-96c8b6c6-aa37-4d40-a4af-75a49ee3ecd1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:56.167472 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-96c8b6c6-aa37-4d40-a4af-75a49ee3ecd1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:56.173308 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-96c8b6c6-aa37-4d40-a4af-75a49ee3ecd1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:56.173774 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-96c8b6c6-aa37-4d40-a4af-75a49ee3ecd1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:56.174566 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-96c8b6c6-aa37-4d40-a4af-75a49ee3ecd1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:56.175011 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-96c8b6c6-aa37-4d40-a4af-75a49ee3ecd1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:56.224702 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b5dd47f4-f0b7-4e56-9b5c-c909d9fe84a7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:56.232052 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b5dd47f4-f0b7-4e56-9b5c-c909d9fe84a7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1614 microversion: 2.1 time: 0.086697 May 12 14:40:56.232733 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 527/1034] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:56 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1614 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:56.326789 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-96c8b6c6-aa37-4d40-a4af-75a49ee3ecd1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:56.335771 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-96c8b6c6-aa37-4d40-a4af-75a49ee3ecd1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:56.337318 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-96c8b6c6-aa37-4d40-a4af-75a49ee3ecd1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:56.338527 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-96c8b6c6-aa37-4d40-a4af-75a49ee3ecd1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.176240 May 12 14:40:56.339162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 508/1035] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:40:56 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:40:56.644008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a8a85c77-430f-4a40-b3c3-e2830e16fdab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:56.644626 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a8a85c77-430f-4a40-b3c3-e2830e16fdab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:56.651841 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8a85c77-430f-4a40-b3c3-e2830e16fdab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:56.652340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8a85c77-430f-4a40-b3c3-e2830e16fdab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:56.653131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8a85c77-430f-4a40-b3c3-e2830e16fdab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:56.653597 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a8a85c77-430f-4a40-b3c3-e2830e16fdab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:56.716666 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a8a85c77-430f-4a40-b3c3-e2830e16fdab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:56.723887 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a8a85c77-430f-4a40-b3c3-e2830e16fdab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1292 microversion: 2.1 time: 0.083972 May 12 14:40:56.724546 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 528/1036] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:56 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:57.249399 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-41bcb190-ba4c-4dd6-9f2f-c4dc70e4b873 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:57.250016 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-41bcb190-ba4c-4dd6-9f2f-c4dc70e4b873 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:57.256379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-41bcb190-ba4c-4dd6-9f2f-c4dc70e4b873 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:57.256837 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-41bcb190-ba4c-4dd6-9f2f-c4dc70e4b873 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:57.257609 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-41bcb190-ba4c-4dd6-9f2f-c4dc70e4b873 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:57.258050 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-41bcb190-ba4c-4dd6-9f2f-c4dc70e4b873 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:57.323529 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-41bcb190-ba4c-4dd6-9f2f-c4dc70e4b873 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:57.324136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-15f7d4c2-d6ab-49e1-9d0d-6f6f73c58212 req-1e5ac685-2214-4e2a-8fcd-46f930c07675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134a856e-1321-471c-bc31-43307ca41802", "name": "network-vif-deleted", "tag": "16daad85-8ecb-4b6e-94ba-93e5f3dce471"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:57.331530 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-41bcb190-ba4c-4dd6-9f2f-c4dc70e4b873 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1614 microversion: 2.1 time: 0.085947 May 12 14:40:57.332021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-15f7d4c2-d6ab-49e1-9d0d-6f6f73c58212 req-1e5ac685-2214-4e2a-8fcd-46f930c07675 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:57.332130 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 509/1037] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:57 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:57.332472 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-15f7d4c2-d6ab-49e1-9d0d-6f6f73c58212 req-1e5ac685-2214-4e2a-8fcd-46f930c07675 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:57.343531 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-15f7d4c2-d6ab-49e1-9d0d-6f6f73c58212 req-1e5ac685-2214-4e2a-8fcd-46f930c07675 service nova] Creating event network-vif-deleted:16daad85-8ecb-4b6e-94ba-93e5f3dce471 for instance 134a856e-1321-471c-bc31-43307ca41802 on hv-cinder-77703 May 12 14:40:57.348675 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-15f7d4c2-d6ab-49e1-9d0d-6f6f73c58212 req-1e5ac685-2214-4e2a-8fcd-46f930c07675 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028787 May 12 14:40:57.349283 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 529/1038] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:40:57.356683 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2f8985e6-7072-4c24-a124-4b75021f63d3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:57.357299 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2f8985e6-7072-4c24-a124-4b75021f63d3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:57.363347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2f8985e6-7072-4c24-a124-4b75021f63d3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:57.363734 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2f8985e6-7072-4c24-a124-4b75021f63d3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:57.364503 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2f8985e6-7072-4c24-a124-4b75021f63d3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:57.364945 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2f8985e6-7072-4c24-a124-4b75021f63d3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:57.487466 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2f8985e6-7072-4c24-a124-4b75021f63d3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:57.495866 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2f8985e6-7072-4c24-a124-4b75021f63d3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:57.497386 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2f8985e6-7072-4c24-a124-4b75021f63d3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:57.498545 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2f8985e6-7072-4c24-a124-4b75021f63d3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.145674 May 12 14:40:57.499138 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 510/1039] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:40:57 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:40:57.741431 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8bf77498-33cb-45b9-86f8-147a1ec56e3b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:57.742134 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8bf77498-33cb-45b9-86f8-147a1ec56e3b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:57.749491 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8bf77498-33cb-45b9-86f8-147a1ec56e3b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:57.749941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8bf77498-33cb-45b9-86f8-147a1ec56e3b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:57.750710 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8bf77498-33cb-45b9-86f8-147a1ec56e3b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:57.751173 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8bf77498-33cb-45b9-86f8-147a1ec56e3b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:57.782743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8bf77498-33cb-45b9-86f8-147a1ec56e3b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:57.783227 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8bf77498-33cb-45b9-86f8-147a1ec56e3b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:57.783676 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-8bf77498-33cb-45b9-86f8-147a1ec56e3b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lazy-loading 'fault' on Instance uuid 137403bd-302f-4ea4-aeba-782ade2358e0 {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:40:57.830806 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8bf77498-33cb-45b9-86f8-147a1ec56e3b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:57.838095 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8bf77498-33cb-45b9-86f8-147a1ec56e3b tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1311 microversion: 2.1 time: 0.100904 May 12 14:40:57.838665 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 530/1040] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:57 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:58.349229 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-5e8becbc-9b64-4050-a6fa-782b0e022253 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:58.349850 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-5e8becbc-9b64-4050-a6fa-782b0e022253 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:58.356795 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5e8becbc-9b64-4050-a6fa-782b0e022253 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:58.357248 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5e8becbc-9b64-4050-a6fa-782b0e022253 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:58.358021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5e8becbc-9b64-4050-a6fa-782b0e022253 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:58.358461 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5e8becbc-9b64-4050-a6fa-782b0e022253 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:58.419941 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-5e8becbc-9b64-4050-a6fa-782b0e022253 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:58.427115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-5e8becbc-9b64-4050-a6fa-782b0e022253 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1614 microversion: 2.1 time: 0.081837 May 12 14:40:58.427719 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 511/1041] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:58 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1614 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:58.517577 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0b65930c-3c1d-4c48-99ad-8876d50f5497 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:58.518387 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0b65930c-3c1d-4c48-99ad-8876d50f5497 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:58.524557 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0b65930c-3c1d-4c48-99ad-8876d50f5497 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:58.525012 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0b65930c-3c1d-4c48-99ad-8876d50f5497 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:58.526322 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0b65930c-3c1d-4c48-99ad-8876d50f5497 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:58.526848 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0b65930c-3c1d-4c48-99ad-8876d50f5497 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:58.649482 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0b65930c-3c1d-4c48-99ad-8876d50f5497 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:58.657684 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0b65930c-3c1d-4c48-99ad-8876d50f5497 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:58.659231 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0b65930c-3c1d-4c48-99ad-8876d50f5497 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:58.660395 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0b65930c-3c1d-4c48-99ad-8876d50f5497 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.146960 May 12 14:40:58.660967 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 531/1042] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:40:58 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:40:58.855107 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-941b8ff3-276b-4434-a7b6-6cf54a11969a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:58.855647 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-941b8ff3-276b-4434-a7b6-6cf54a11969a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:58.863319 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-941b8ff3-276b-4434-a7b6-6cf54a11969a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:58.864081 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-941b8ff3-276b-4434-a7b6-6cf54a11969a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:58.865495 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-941b8ff3-276b-4434-a7b6-6cf54a11969a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:58.866196 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-941b8ff3-276b-4434-a7b6-6cf54a11969a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:58.901950 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-941b8ff3-276b-4434-a7b6-6cf54a11969a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:58.902405 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-941b8ff3-276b-4434-a7b6-6cf54a11969a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:58.902858 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-941b8ff3-276b-4434-a7b6-6cf54a11969a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lazy-loading 'fault' on Instance uuid 137403bd-302f-4ea4-aeba-782ade2358e0 {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:40:58.943133 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-941b8ff3-276b-4434-a7b6-6cf54a11969a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:58.951167 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-941b8ff3-276b-4434-a7b6-6cf54a11969a tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1311 microversion: 2.1 time: 0.100100 May 12 14:40:58.951734 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 512/1043] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:58 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:59.444382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c054ae9a-d80f-4674-ab5f-7e244f0fe20e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:59.444948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c054ae9a-d80f-4674-ab5f-7e244f0fe20e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:59.451867 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c054ae9a-d80f-4674-ab5f-7e244f0fe20e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:59.452329 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c054ae9a-d80f-4674-ab5f-7e244f0fe20e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:59.453108 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c054ae9a-d80f-4674-ab5f-7e244f0fe20e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:59.453553 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c054ae9a-d80f-4674-ab5f-7e244f0fe20e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:59.483911 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c054ae9a-d80f-4674-ab5f-7e244f0fe20e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:59.484488 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c054ae9a-d80f-4674-ab5f-7e244f0fe20e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:59.484954 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-c054ae9a-d80f-4674-ab5f-7e244f0fe20e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lazy-loading 'fault' on Instance uuid 134a856e-1321-471c-bc31-43307ca41802 {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:40:59.528157 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c054ae9a-d80f-4674-ab5f-7e244f0fe20e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:59.535633 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c054ae9a-d80f-4674-ab5f-7e244f0fe20e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 200 len: 1332 microversion: 2.1 time: 0.095207 May 12 14:40:59.536215 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 532/1044] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:59 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:59.678265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2149cedb-4d00-4021-b48f-8475aa234344 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:59.678876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2149cedb-4d00-4021-b48f-8475aa234344 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:59.687101 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2149cedb-4d00-4021-b48f-8475aa234344 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:59.687562 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2149cedb-4d00-4021-b48f-8475aa234344 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:59.688347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2149cedb-4d00-4021-b48f-8475aa234344 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:59.688788 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2149cedb-4d00-4021-b48f-8475aa234344 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:59.820914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2149cedb-4d00-4021-b48f-8475aa234344 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:59.830348 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2149cedb-4d00-4021-b48f-8475aa234344 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:59.832125 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2149cedb-4d00-4021-b48f-8475aa234344 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:40:59.833384 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2149cedb-4d00-4021-b48f-8475aa234344 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.159415 May 12 14:40:59.834025 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 513/1045] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:40:59 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:40:59.967498 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d6f48e89-7a47-414e-8e20-242bad0ad9e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:59.968121 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d6f48e89-7a47-414e-8e20-242bad0ad9e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:40:59.973908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d6f48e89-7a47-414e-8e20-242bad0ad9e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:59.974367 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d6f48e89-7a47-414e-8e20-242bad0ad9e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:40:59.975175 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d6f48e89-7a47-414e-8e20-242bad0ad9e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:40:59.975619 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d6f48e89-7a47-414e-8e20-242bad0ad9e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:00.008891 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d6f48e89-7a47-414e-8e20-242bad0ad9e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:00.009432 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d6f48e89-7a47-414e-8e20-242bad0ad9e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:00.009948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-d6f48e89-7a47-414e-8e20-242bad0ad9e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lazy-loading 'fault' on Instance uuid 137403bd-302f-4ea4-aeba-782ade2358e0 {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:41:00.051831 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d6f48e89-7a47-414e-8e20-242bad0ad9e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:00.060081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d6f48e89-7a47-414e-8e20-242bad0ad9e4 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 200 len: 1311 microversion: 2.1 time: 0.096419 May 12 14:41:00.060651 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 533/1046] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:40:59 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:00.553263 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d271d46d-1f3d-475d-9558-e936899c6be6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:00.553873 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d271d46d-1f3d-475d-9558-e936899c6be6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:00.559776 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d271d46d-1f3d-475d-9558-e936899c6be6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:00.560233 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d271d46d-1f3d-475d-9558-e936899c6be6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:00.561005 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d271d46d-1f3d-475d-9558-e936899c6be6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:00.561445 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d271d46d-1f3d-475d-9558-e936899c6be6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:00.574259 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-d271d46d-1f3d-475d-9558-e936899c6be6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] HTTP exception thrown: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d271d46d-1f3d-475d-9558-e936899c6be6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Request method failure captured: May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 HTTP/1.1 May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRo-ycWfHqPPxbmLiuTXrtXJLZwYU78oTuGhPDkiQSHU7CKcy_GQqpZ_HWFwpOkfP_a2cy2OZwfawJtQIkHx1tZyLxJZoQOwjSpujcF6pQ0BcV3O7kKLbSCm6-7BGei9mU5XP-t1FCFU5rK_O_aRKcjHsdbD5yR-8mP9_YNetCjLQkw May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:41:00.575910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:41:00.577487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4b5ca018b5f4dda99486407424b8168", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:41:00.577487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-AttachVolumeNegativeTest-523912070 May 12 14:41:00.577487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:41:00.577487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:41:00.577487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:41:00.577487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:41:00.577487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:41:00.577487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: c6422873a3b84aac88f8a93291bcd7b0 May 12 14:41:00.577487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:41:00.577487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:41:00.577487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. May 12 14:41:00.577487 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '134a856e-1321-471c-bc31-43307ca41802'} May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:41:00.578437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. May 12 14:41:00.580035 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:41:00.581424 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d271d46d-1f3d-475d-9558-e936899c6be6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Returning 404 to user: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:41:00.581424 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d271d46d-1f3d-475d-9558-e936899c6be6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 404 len: 111 microversion: 2.1 time: 0.027975 May 12 14:41:00.581424 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 514/1047] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:00 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:41:00.586115 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5a3ce0b5-aa67-4373-9721-abac7a845395 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '.version_select at 0x7f5b2682a1f0>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:00.604688 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5a3ce0b5-aa67-4373-9721-abac7a845395 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312984141" status: 202 len: 0 microversion: 2.1 time: 0.021708 May 12 14:41:00.605274 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 534/1048] 10.222.0.75 () {58 vars in 1220 bytes} [Thu May 12 14:41:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312984141 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:41:00.851645 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3d5b00ac-a358-4f4f-8c4c-ec15d841cbd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:00.852257 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3d5b00ac-a358-4f4f-8c4c-ec15d841cbd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:00.858470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3d5b00ac-a358-4f4f-8c4c-ec15d841cbd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:00.858928 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3d5b00ac-a358-4f4f-8c4c-ec15d841cbd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:00.859732 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3d5b00ac-a358-4f4f-8c4c-ec15d841cbd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:00.860176 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3d5b00ac-a358-4f4f-8c4c-ec15d841cbd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:01.055711 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3d5b00ac-a358-4f4f-8c4c-ec15d841cbd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:01.063454 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3d5b00ac-a358-4f4f-8c4c-ec15d841cbd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:01.064980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3d5b00ac-a358-4f4f-8c4c-ec15d841cbd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:01.066145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3d5b00ac-a358-4f4f-8c4c-ec15d841cbd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.218406 May 12 14:41:01.066712 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 515/1049] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:00 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:01.076938 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-db2b48d4-c945-4c09-8a03-4ac6e0c18003 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:01.077640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-db2b48d4-c945-4c09-8a03-4ac6e0c18003 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 137403bd-302f-4ea4-aeba-782ade2358e0] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:01.083463 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-db2b48d4-c945-4c09-8a03-4ac6e0c18003 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:01.083923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-db2b48d4-c945-4c09-8a03-4ac6e0c18003 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:01.084702 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-db2b48d4-c945-4c09-8a03-4ac6e0c18003 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:01.085147 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-db2b48d4-c945-4c09-8a03-4ac6e0c18003 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:01.098994 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-db2b48d4-c945-4c09-8a03-4ac6e0c18003 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] HTTP exception thrown: Instance 137403bd-302f-4ea4-aeba-782ade2358e0 could not be found. May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-db2b48d4-c945-4c09-8a03-4ac6e0c18003 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Request method failure captured: May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 HTTP/1.1 May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRq0uWuP3TVHlLteeytECkdY1IHk4Hm4jgv2EqCnNnd6d7UG3PWB-NuAqkTLkf0WOJPkE44_BXmJ11jpUpyyW5sLjohov-DKwiXHfMHAMPjixk4n1DyvIkCubo7puSPwFp_XC3lYOHR3XN9hdOa8f44jvM5ppqXDZozdTAyrt_DDmpY May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 3c83c8fa2cd44eab84cb50b3ad06a1d3 May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1594015429 May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:41:01.100678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:41:01.102293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3c83c8fa2cd44eab84cb50b3ad06a1d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c83c8fa2cd44eab84cb50b3ad06a1d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3c83c8fa2cd44eab84cb50b3ad06a1d3", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c83c8fa2cd44eab84cb50b3ad06a1d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:41:01.102293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1594015429 May 12 14:41:01.102293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 3c83c8fa2cd44eab84cb50b3ad06a1d3 May 12 14:41:01.102293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1594015429 May 12 14:41:01.102293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-ServerRescueNegativeTestJSON-1594015429-project May 12 14:41:01.102293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:41:01.102293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:41:01.102293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: 2cfa47f1da4e4ae9a358e2b8ace795ac May 12 14:41:01.102293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1594015429-project May 12 14:41:01.102293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:41:01.102293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance 137403bd-302f-4ea4-aeba-782ade2358e0 could not be found. May 12 14:41:01.102293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': '137403bd-302f-4ea4-aeba-782ade2358e0'} May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 137403bd-302f-4ea4-aeba-782ade2358e0 could not be found. May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:41:01.103177 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 137403bd-302f-4ea4-aeba-782ade2358e0 could not be found. May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 137403bd-302f-4ea4-aeba-782ade2358e0 could not be found. May 12 14:41:01.104374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:41:01.105502 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-db2b48d4-c945-4c09-8a03-4ac6e0c18003 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Returning 404 to user: Instance 137403bd-302f-4ea4-aeba-782ade2358e0 could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:41:01.105502 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-db2b48d4-c945-4c09-8a03-4ac6e0c18003 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0" status: 404 len: 111 microversion: 2.1 time: 0.029613 May 12 14:41:01.105502 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 535/1050] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:01 2022] GET /compute/v2.1/servers/137403bd-302f-4ea4-aeba-782ade2358e0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:41:01.110725 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-94c3a983-f072-4e91-8380-b62b201e2bb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:01.111258 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-94c3a983-f072-4e91-8380-b62b201e2bb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:01.117034 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-94c3a983-f072-4e91-8380-b62b201e2bb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:01.117488 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-94c3a983-f072-4e91-8380-b62b201e2bb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:01.118550 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-94c3a983-f072-4e91-8380-b62b201e2bb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:01.119708 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-94c3a983-f072-4e91-8380-b62b201e2bb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:01.150846 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-94c3a983-f072-4e91-8380-b62b201e2bb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Going to try to terminate instance {{(pid=118216) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:41:01.242614 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-94c3a983-f072-4e91-8380-b62b201e2bb7 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "DELETE /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 204 len: 0 microversion: 2.1 time: 0.135310 May 12 14:41:01.243875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 516/1051] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:41:01 2022] DELETE /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:41:01.252072 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a5cd26fb-15c5-461d-a612-65a7153bcdb3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:01.252697 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a5cd26fb-15c5-461d-a612-65a7153bcdb3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:01.258438 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a5cd26fb-15c5-461d-a612-65a7153bcdb3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:01.258896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a5cd26fb-15c5-461d-a612-65a7153bcdb3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:01.259717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a5cd26fb-15c5-461d-a612-65a7153bcdb3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:01.260160 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a5cd26fb-15c5-461d-a612-65a7153bcdb3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:01.294002 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-5ec6972e-a47f-4aa7-9b32-c4fb6958fb58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Action: 'create', calling method: .version_select at 0x7f5b260a1820>, body: {"keypair": {"name": "tempest-keypair-160895428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLTm6BTBphRW3kfk6v/fYMnT3ZNUwXswyc2xddulLkqfnvJDh7U9a6Ck0KtL9K1LhXiNnQ5IS5khDCXOtr6DV8U0IGfkiINVTZ9nyVLQH+CL6mv1Fd9IbjP6sOcOh7j5Q=="}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:01.307873 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-5ec6972e-a47f-4aa7-9b32-c4fb6958fb58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for project e4b5ca018b5f4dda99486407424b8168. Resources: {'key_pairs'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:41:01.311704 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-5ec6972e-a47f-4aa7-9b32-c4fb6958fb58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for user c6422873a3b84aac88f8a93291bcd7b0 and project e4b5ca018b5f4dda99486407424b8168. Resources: {'key_pairs'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:41:01.333142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-5ec6972e-a47f-4aa7-9b32-c4fb6958fb58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044012 May 12 14:41:01.333759 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 517/1052] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 12 14:41:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:41:01.391565 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a5cd26fb-15c5-461d-a612-65a7153bcdb3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:01.399284 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a5cd26fb-15c5-461d-a612-65a7153bcdb3 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.151048 May 12 14:41:01.399862 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 536/1053] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:01 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:02.084800 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-32c92b75-a798-4416-836e-8954e7437355 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:02.085538 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-32c92b75-a798-4416-836e-8954e7437355 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:02.093544 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-32c92b75-a798-4416-836e-8954e7437355 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:02.094010 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-32c92b75-a798-4416-836e-8954e7437355 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:02.094819 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-32c92b75-a798-4416-836e-8954e7437355 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:02.095292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-32c92b75-a798-4416-836e-8954e7437355 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:02.275280 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-32c92b75-a798-4416-836e-8954e7437355 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:02.283165 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-32c92b75-a798-4416-836e-8954e7437355 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:02.284710 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-32c92b75-a798-4416-836e-8954e7437355 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:02.285903 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-32c92b75-a798-4416-836e-8954e7437355 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.205103 May 12 14:41:02.286455 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 518/1054] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:02 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:02.416669 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-21423f64-9bf5-4fa7-975f-d1ddaa97a6ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:02.417300 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-21423f64-9bf5-4fa7-975f-d1ddaa97a6ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:02.424241 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-21423f64-9bf5-4fa7-975f-d1ddaa97a6ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:02.424712 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-21423f64-9bf5-4fa7-975f-d1ddaa97a6ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:02.425491 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-21423f64-9bf5-4fa7-975f-d1ddaa97a6ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:02.425936 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-21423f64-9bf5-4fa7-975f-d1ddaa97a6ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:02.681764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-21423f64-9bf5-4fa7-975f-d1ddaa97a6ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:02.689115 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-21423f64-9bf5-4fa7-975f-d1ddaa97a6ab tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1523 microversion: 2.1 time: 0.276326 May 12 14:41:02.689871 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 537/1055] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:02 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:02.744891 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1888303180", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fdc0b19-4053-4c44-8b08-cd1ab3959461"}], "security_groups": [{"name": "tempest-securitygroup--346062499"}], "key_name": "tempest-keypair-160895428", "user_data": "}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:02.900163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.network.neutron [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] validate_networks() for [('3fdc0b19-4053-4c44-8b08-cd1ab3959461', None, None, None, None, None)] {{(pid=118216) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:41:03.306153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8d1d0f82-be94-41ba-803c-117e84c98177 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:03.307933 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8d1d0f82-be94-41ba-803c-117e84c98177 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:03.314478 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d1d0f82-be94-41ba-803c-117e84c98177 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:03.314942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d1d0f82-be94-41ba-803c-117e84c98177 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:03.315792 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d1d0f82-be94-41ba-803c-117e84c98177 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:03.316425 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d1d0f82-be94-41ba-803c-117e84c98177 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:03.533810 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8d1d0f82-be94-41ba-803c-117e84c98177 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:03.535567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Flavor limits 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:41:03.535997 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Image limits 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:41:03.536471 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Flavor pref 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:41:03.536881 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Image pref 0:0:0 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:41:03.537291 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.virt.hardware [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:41:03.541703 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8d1d0f82-be94-41ba-803c-117e84c98177 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:03.543424 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8d1d0f82-be94-41ba-803c-117e84c98177 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:03.544706 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8d1d0f82-be94-41ba-803c-117e84c98177 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.243885 May 12 14:41:03.545349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 538/1056] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:03 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:03.547231 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:03.547884 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:03.548860 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:03.549513 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:03.549729 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-82bb3848-202a-47dd-a0fe-200f8180f59f req-bbd4a7a3-f7aa-4146-8a0b-6af0fa03802f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5ced7e-9d8b-4d24-a35d-876326b483ba", "name": "network-vif-deleted", "tag": "62f6a176-00c7-4955-ac5a-e84fb95f6c3d"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:03.557812 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-82bb3848-202a-47dd-a0fe-200f8180f59f req-bbd4a7a3-f7aa-4146-8a0b-6af0fa03802f service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:03.559005 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-82bb3848-202a-47dd-a0fe-200f8180f59f req-bbd4a7a3-f7aa-4146-8a0b-6af0fa03802f service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:03.566501 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for project e4b5ca018b5f4dda99486407424b8168. Resources: {'cores', 'instances', 'ram'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:41:03.569847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-82bb3848-202a-47dd-a0fe-200f8180f59f req-bbd4a7a3-f7aa-4146-8a0b-6af0fa03802f service nova] Creating event network-vif-deleted:62f6a176-00c7-4955-ac5a-e84fb95f6c3d for instance 5c5ced7e-9d8b-4d24-a35d-876326b483ba on hv-cinder-77703 May 12 14:41:03.570641 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Getting quotas for user c6422873a3b84aac88f8a93291bcd7b0 and project e4b5ca018b5f4dda99486407424b8168. Resources: {'cores', 'instances', 'ram'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:41:03.575445 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-82bb3848-202a-47dd-a0fe-200f8180f59f req-bbd4a7a3-f7aa-4146-8a0b-6af0fa03802f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028932 May 12 14:41:03.576024 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 539/1057] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:03.584491 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Going to run 1 instances... {{(pid=118216) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:41:03.586826 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:41:03.636492 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d84470d9-a7bc-4931-83d4-5d9bbef7d824 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.896097 May 12 14:41:03.637703 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 519/1058] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:41:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 14:41:03.648655 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4476ade2-114a-489b-abb7-138322291252 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:03.649381 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4476ade2-114a-489b-abb7-138322291252 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:03.705705 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4476ade2-114a-489b-abb7-138322291252 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:03.706434 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6c8c4e18-4dfa-4e1a-a0f7-bcb73512915c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:03.707089 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6c8c4e18-4dfa-4e1a-a0f7-bcb73512915c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:03.713296 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4476ade2-114a-489b-abb7-138322291252 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1241 microversion: 2.1 time: 0.069168 May 12 14:41:03.713589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c8c4e18-4dfa-4e1a-a0f7-bcb73512915c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:03.714059 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c8c4e18-4dfa-4e1a-a0f7-bcb73512915c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:03.714511 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 540/1059] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:03 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:03.723117 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c8c4e18-4dfa-4e1a-a0f7-bcb73512915c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:03.723117 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c8c4e18-4dfa-4e1a-a0f7-bcb73512915c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:03.752851 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c8c4e18-4dfa-4e1a-a0f7-bcb73512915c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:03.753290 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6c8c4e18-4dfa-4e1a-a0f7-bcb73512915c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:03.753748 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-6c8c4e18-4dfa-4e1a-a0f7-bcb73512915c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lazy-loading 'fault' on Instance uuid 5c5ced7e-9d8b-4d24-a35d-876326b483ba {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:41:03.799149 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6c8c4e18-4dfa-4e1a-a0f7-bcb73512915c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cfa47f1da4e4ae9a358e2b8ace795ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:03.806389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6c8c4e18-4dfa-4e1a-a0f7-bcb73512915c tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 200 len: 1312 microversion: 2.1 time: 0.104038 May 12 14:41:03.807925 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 520/1060] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:03 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:41:04.562981 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2ce673a3-eb11-497d-9518-3bf2b5696000 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:04.563585 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2ce673a3-eb11-497d-9518-3bf2b5696000 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:04.572181 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2ce673a3-eb11-497d-9518-3bf2b5696000 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:04.572635 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2ce673a3-eb11-497d-9518-3bf2b5696000 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:04.573404 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2ce673a3-eb11-497d-9518-3bf2b5696000 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:04.573844 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2ce673a3-eb11-497d-9518-3bf2b5696000 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:04.703740 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2ce673a3-eb11-497d-9518-3bf2b5696000 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:04.711781 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2ce673a3-eb11-497d-9518-3bf2b5696000 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:04.713217 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2ce673a3-eb11-497d-9518-3bf2b5696000 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:04.714416 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2ce673a3-eb11-497d-9518-3bf2b5696000 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.155400 May 12 14:41:04.715651 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 541/1061] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:04 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:04.731000 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e53f883f-f58c-4206-bd8f-9f0a1bf8b994 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:04.731739 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e53f883f-f58c-4206-bd8f-9f0a1bf8b994 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:04.738995 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e53f883f-f58c-4206-bd8f-9f0a1bf8b994 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:04.739507 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e53f883f-f58c-4206-bd8f-9f0a1bf8b994 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:04.740292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e53f883f-f58c-4206-bd8f-9f0a1bf8b994 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:04.740742 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e53f883f-f58c-4206-bd8f-9f0a1bf8b994 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:04.813120 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e53f883f-f58c-4206-bd8f-9f0a1bf8b994 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:04.820911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e53f883f-f58c-4206-bd8f-9f0a1bf8b994 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1301 microversion: 2.1 time: 0.093969 May 12 14:41:04.821545 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 521/1062] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:04 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:04.825157 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5cc6e40f-9790-48c4-a051-be86016642d1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:04.825921 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5cc6e40f-9790-48c4-a051-be86016642d1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] [instance: 5c5ced7e-9d8b-4d24-a35d-876326b483ba] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:04.832305 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5cc6e40f-9790-48c4-a051-be86016642d1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:04.832834 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5cc6e40f-9790-48c4-a051-be86016642d1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:04.833709 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5cc6e40f-9790-48c4-a051-be86016642d1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:04.835051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5cc6e40f-9790-48c4-a051-be86016642d1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:04.850624 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-5cc6e40f-9790-48c4-a051-be86016642d1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] HTTP exception thrown: Instance 5c5ced7e-9d8b-4d24-a35d-876326b483ba could not be found. May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5cc6e40f-9790-48c4-a051-be86016642d1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Request method failure captured: May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba HTTP/1.1 May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRq0uWuP3TVHlLteeytECkdY1IHk4Hm4jgv2EqCnNnd6d7UG3PWB-NuAqkTLkf0WOJPkE44_BXmJ11jpUpyyW5sLjohov-DKwiXHfMHAMPjixk4n1DyvIkCubo7puSPwFp_XC3lYOHR3XN9hdOa8f44jvM5ppqXDZozdTAyrt_DDmpY May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 3c83c8fa2cd44eab84cb50b3ad06a1d3 May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1594015429 May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:41:04.852540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:41:04.853850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3c83c8fa2cd44eab84cb50b3ad06a1d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c83c8fa2cd44eab84cb50b3ad06a1d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3c83c8fa2cd44eab84cb50b3ad06a1d3", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3c83c8fa2cd44eab84cb50b3ad06a1d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:41:04.853850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1594015429 May 12 14:41:04.853850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 3c83c8fa2cd44eab84cb50b3ad06a1d3 May 12 14:41:04.853850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1594015429 May 12 14:41:04.853850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-ServerRescueNegativeTestJSON-1594015429-project May 12 14:41:04.853850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:41:04.853850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:41:04.853850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: 2cfa47f1da4e4ae9a358e2b8ace795ac May 12 14:41:04.853850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1594015429-project May 12 14:41:04.853850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:41:04.853850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance 5c5ced7e-9d8b-4d24-a35d-876326b483ba could not be found. May 12 14:41:04.853850 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': '5c5ced7e-9d8b-4d24-a35d-876326b483ba'} May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c5ced7e-9d8b-4d24-a35d-876326b483ba could not be found. May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:41:04.854566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c5ced7e-9d8b-4d24-a35d-876326b483ba could not be found. May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c5ced7e-9d8b-4d24-a35d-876326b483ba could not be found. May 12 14:41:04.855941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:41:04.857008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5cc6e40f-9790-48c4-a051-be86016642d1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] Returning 404 to user: Instance 5c5ced7e-9d8b-4d24-a35d-876326b483ba could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:41:04.857008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5cc6e40f-9790-48c4-a051-be86016642d1 tempest-ServerRescueNegativeTestJSON-1594015429 tempest-ServerRescueNegativeTestJSON-1594015429-project] 10.222.0.75 "GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba" status: 404 len: 111 microversion: 2.1 time: 0.034081 May 12 14:41:04.857008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 542/1063] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:04 2022] GET /compute/v2.1/servers/5c5ced7e-9d8b-4d24-a35d-876326b483ba => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:41:05.733134 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c9f3f8f2-0e88-4fcc-84ce-8987cc98795b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:05.734442 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c9f3f8f2-0e88-4fcc-84ce-8987cc98795b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:05.741320 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c9f3f8f2-0e88-4fcc-84ce-8987cc98795b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:05.742110 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c9f3f8f2-0e88-4fcc-84ce-8987cc98795b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:05.742992 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c9f3f8f2-0e88-4fcc-84ce-8987cc98795b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:05.743968 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c9f3f8f2-0e88-4fcc-84ce-8987cc98795b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:05.838199 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f38eb3a4-8331-48a8-90a2-32fbc5e6bde1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:05.839423 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f38eb3a4-8331-48a8-90a2-32fbc5e6bde1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:05.846253 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f38eb3a4-8331-48a8-90a2-32fbc5e6bde1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:05.846727 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f38eb3a4-8331-48a8-90a2-32fbc5e6bde1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:05.847773 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f38eb3a4-8331-48a8-90a2-32fbc5e6bde1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:05.848165 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f38eb3a4-8331-48a8-90a2-32fbc5e6bde1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:06.026423 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c9f3f8f2-0e88-4fcc-84ce-8987cc98795b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:06.038769 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c9f3f8f2-0e88-4fcc-84ce-8987cc98795b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:06.040784 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c9f3f8f2-0e88-4fcc-84ce-8987cc98795b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:06.042707 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c9f3f8f2-0e88-4fcc-84ce-8987cc98795b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.313558 May 12 14:41:06.057323 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 522/1064] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:05 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:06.137903 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f38eb3a4-8331-48a8-90a2-32fbc5e6bde1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:06.146247 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f38eb3a4-8331-48a8-90a2-32fbc5e6bde1 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1366 microversion: 2.1 time: 0.312080 May 12 14:41:06.156818 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 543/1065] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:05 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:06.524464 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-55882173-c124-4a20-b7dc-86054a3e69f2 req-035f6ce2-dba6-46d8-81f9-beff0f4b038c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b293e6a7-b82d-44db-af30-498fd91a7261", "tag": "72bdfac6-9a66-4d48-b364-b06fc90433ed"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:06.546934 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-55882173-c124-4a20-b7dc-86054a3e69f2 req-035f6ce2-dba6-46d8-81f9-beff0f4b038c service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:06.549415 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-55882173-c124-4a20-b7dc-86054a3e69f2 req-035f6ce2-dba6-46d8-81f9-beff0f4b038c service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:06.573609 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-55882173-c124-4a20-b7dc-86054a3e69f2 req-035f6ce2-dba6-46d8-81f9-beff0f4b038c service nova] Creating event network-changed:72bdfac6-9a66-4d48-b364-b06fc90433ed for instance b293e6a7-b82d-44db-af30-498fd91a7261 on hv-cinder-77703 May 12 14:41:06.586654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-55882173-c124-4a20-b7dc-86054a3e69f2 req-035f6ce2-dba6-46d8-81f9-beff0f4b038c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065698 May 12 14:41:06.589153 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 523/1066] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:06.632389 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1438600726", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-349363195", "security_groups": [{"name": "tempest-secgroup-smoke-2090511352"}], "block_device_mapping_v2": [{"uuid": "3852380d-e0bf-4727-89c6-fe01b825f7f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5b96f110-6030-45d9-96d1-0bc86d38fd01"}]}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:07.062321 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e48f0340-9dec-40dc-9ca9-278862f6a75d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:07.063347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e48f0340-9dec-40dc-9ca9-278862f6a75d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:07.070208 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e48f0340-9dec-40dc-9ca9-278862f6a75d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:07.070872 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e48f0340-9dec-40dc-9ca9-278862f6a75d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:07.071781 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e48f0340-9dec-40dc-9ca9-278862f6a75d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:07.072401 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e48f0340-9dec-40dc-9ca9-278862f6a75d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:07.076316 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.network.neutron [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] validate_networks() for [('5b96f110-6030-45d9-96d1-0bc86d38fd01', None, None, None, None, None)] {{(pid=118217) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:41:07.461961 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e48f0340-9dec-40dc-9ca9-278862f6a75d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:07.470416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e48f0340-9dec-40dc-9ca9-278862f6a75d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:07.472065 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e48f0340-9dec-40dc-9ca9-278862f6a75d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:07.473310 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e48f0340-9dec-40dc-9ca9-278862f6a75d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.415375 May 12 14:41:07.477836 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 524/1067] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:07 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:41:07.478666 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6406469e-b8a1-443b-9c2d-053aa21242c6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:07.479499 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6406469e-b8a1-443b-9c2d-053aa21242c6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:07.485890 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6406469e-b8a1-443b-9c2d-053aa21242c6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:07.486345 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6406469e-b8a1-443b-9c2d-053aa21242c6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:07.487203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6406469e-b8a1-443b-9c2d-053aa21242c6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:07.487650 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6406469e-b8a1-443b-9c2d-053aa21242c6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:07.882697 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6406469e-b8a1-443b-9c2d-053aa21242c6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:07.890073 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6406469e-b8a1-443b-9c2d-053aa21242c6 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1366 microversion: 2.1 time: 0.415148 May 12 14:41:07.890645 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 525/1068] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:07 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:08.061961 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Flavor limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:41:08.062390 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Image limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:41:08.062869 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Flavor pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:41:08.063316 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Image pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:41:08.063747 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:41:08.072388 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:08.072837 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:08.073646 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:08.074115 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:08.090628 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Getting quotas for project 0ba0ea753bb0496cbf274e802f50dd0e. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:41:08.094487 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Getting quotas for user a64c3ea69151401897e4203095676543 and project 0ba0ea753bb0496cbf274e802f50dd0e. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:41:08.153956 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Going to run 1 instances... {{(pid=118217) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:41:08.156118 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3852380d-e0bf-4727-89c6-fe01b825f7f5',volume_size=None,volume_type=None)] {{(pid=118217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:41:08.287496 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2f26731f-3a22-48ad-8bee-3e9ec75c8a63 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.659682 May 12 14:41:08.288491 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 544/1069] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:41:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:41:08.298327 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2fcd95de-ea0a-40f5-937f-2ff7256f3bf4 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:08.299109 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2fcd95de-ea0a-40f5-937f-2ff7256f3bf4 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:08.399394 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2fcd95de-ea0a-40f5-937f-2ff7256f3bf4 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:08.408316 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2fcd95de-ea0a-40f5-937f-2ff7256f3bf4 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1094 microversion: 2.1 time: 0.113469 May 12 14:41:08.409090 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 526/1070] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:08 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1094 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:08.494933 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e7424683-dffe-4213-97ac-615c1aecbb5b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:08.495638 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e7424683-dffe-4213-97ac-615c1aecbb5b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:08.502796 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e7424683-dffe-4213-97ac-615c1aecbb5b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:08.503468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e7424683-dffe-4213-97ac-615c1aecbb5b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:08.504913 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e7424683-dffe-4213-97ac-615c1aecbb5b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:08.505879 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e7424683-dffe-4213-97ac-615c1aecbb5b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:08.760856 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e7424683-dffe-4213-97ac-615c1aecbb5b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:08.769766 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e7424683-dffe-4213-97ac-615c1aecbb5b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:08.771383 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e7424683-dffe-4213-97ac-615c1aecbb5b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:08.772714 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e7424683-dffe-4213-97ac-615c1aecbb5b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.283685 May 12 14:41:08.773289 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 545/1071] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:08 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:08.906507 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b1607e2c-c71d-416e-b429-ec2654714fb3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:08.907191 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b1607e2c-c71d-416e-b429-ec2654714fb3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:08.913991 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b1607e2c-c71d-416e-b429-ec2654714fb3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:08.914513 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b1607e2c-c71d-416e-b429-ec2654714fb3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:08.915906 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b1607e2c-c71d-416e-b429-ec2654714fb3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:08.916419 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b1607e2c-c71d-416e-b429-ec2654714fb3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:09.146830 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b1607e2c-c71d-416e-b429-ec2654714fb3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:09.159270 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b1607e2c-c71d-416e-b429-ec2654714fb3 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1366 microversion: 2.1 time: 0.257182 May 12 14:41:09.160331 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 527/1072] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:08 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:09.424809 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-330f5a0a-173d-4e09-9293-3c626edb42e3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:09.425428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-330f5a0a-173d-4e09-9293-3c626edb42e3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:09.432042 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-330f5a0a-173d-4e09-9293-3c626edb42e3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:09.432500 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-330f5a0a-173d-4e09-9293-3c626edb42e3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:09.433275 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-330f5a0a-173d-4e09-9293-3c626edb42e3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:09.434261 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-330f5a0a-173d-4e09-9293-3c626edb42e3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:09.509070 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-330f5a0a-173d-4e09-9293-3c626edb42e3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:09.518221 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-330f5a0a-173d-4e09-9293-3c626edb42e3 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1144 microversion: 2.1 time: 0.097242 May 12 14:41:09.526791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 546/1073] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:09 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1144 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:09.791133 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-eb6b28e0-d66b-4a30-ac79-c8ba79f64128 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:09.791746 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-eb6b28e0-d66b-4a30-ac79-c8ba79f64128 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:09.798711 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb6b28e0-d66b-4a30-ac79-c8ba79f64128 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:09.799583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb6b28e0-d66b-4a30-ac79-c8ba79f64128 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:09.800599 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb6b28e0-d66b-4a30-ac79-c8ba79f64128 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:09.801203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-eb6b28e0-d66b-4a30-ac79-c8ba79f64128 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:09.940190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-eb6b28e0-d66b-4a30-ac79-c8ba79f64128 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:09.947851 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-eb6b28e0-d66b-4a30-ac79-c8ba79f64128 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:09.949911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-eb6b28e0-d66b-4a30-ac79-c8ba79f64128 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:09.951145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-eb6b28e0-d66b-4a30-ac79-c8ba79f64128 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.163982 May 12 14:41:09.951718 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 528/1074] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:09 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:10.180727 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f4c360fd-f88b-47ca-82de-17f4650dc3bd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:10.181341 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f4c360fd-f88b-47ca-82de-17f4650dc3bd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:10.187603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f4c360fd-f88b-47ca-82de-17f4650dc3bd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:10.188056 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f4c360fd-f88b-47ca-82de-17f4650dc3bd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:10.188821 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f4c360fd-f88b-47ca-82de-17f4650dc3bd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:10.189255 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f4c360fd-f88b-47ca-82de-17f4650dc3bd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:10.323625 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f4c360fd-f88b-47ca-82de-17f4650dc3bd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:10.332394 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f4c360fd-f88b-47ca-82de-17f4650dc3bd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1366 microversion: 2.1 time: 0.155532 May 12 14:41:10.332971 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 547/1075] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:10 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:10.535355 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-82983c4f-ef37-4805-9cea-6b130794169d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:10.535968 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-82983c4f-ef37-4805-9cea-6b130794169d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:10.542139 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-82983c4f-ef37-4805-9cea-6b130794169d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:10.542593 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-82983c4f-ef37-4805-9cea-6b130794169d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:10.543903 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-82983c4f-ef37-4805-9cea-6b130794169d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:10.544343 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-82983c4f-ef37-4805-9cea-6b130794169d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:10.636766 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-82983c4f-ef37-4805-9cea-6b130794169d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:10.644730 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-82983c4f-ef37-4805-9cea-6b130794169d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1144 microversion: 2.1 time: 0.113178 May 12 14:41:10.655068 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 529/1076] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:10 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1144 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:10.970052 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-56604958-2aef-43be-b9eb-e5fc6f3ba4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:10.970696 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-56604958-2aef-43be-b9eb-e5fc6f3ba4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:10.977271 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-56604958-2aef-43be-b9eb-e5fc6f3ba4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:10.977729 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-56604958-2aef-43be-b9eb-e5fc6f3ba4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:10.978524 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-56604958-2aef-43be-b9eb-e5fc6f3ba4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:10.978946 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-56604958-2aef-43be-b9eb-e5fc6f3ba4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:11.248324 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-56604958-2aef-43be-b9eb-e5fc6f3ba4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:11.256345 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-56604958-2aef-43be-b9eb-e5fc6f3ba4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:11.257877 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-56604958-2aef-43be-b9eb-e5fc6f3ba4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:11.259311 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-56604958-2aef-43be-b9eb-e5fc6f3ba4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.293239 May 12 14:41:11.260075 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 548/1077] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:10 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:11.349365 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-38fb86fe-2243-4639-913c-c94583507168 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:11.357136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-38fb86fe-2243-4639-913c-c94583507168 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:11.363572 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-38fb86fe-2243-4639-913c-c94583507168 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:11.364061 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-38fb86fe-2243-4639-913c-c94583507168 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:11.376095 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-38fb86fe-2243-4639-913c-c94583507168 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:11.376558 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-38fb86fe-2243-4639-913c-c94583507168 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:11.669217 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5c6a4697-f2ae-4e19-83f4-2d65ee22d313 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:11.669838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5c6a4697-f2ae-4e19-83f4-2d65ee22d313 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:11.677844 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5c6a4697-f2ae-4e19-83f4-2d65ee22d313 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:11.678294 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5c6a4697-f2ae-4e19-83f4-2d65ee22d313 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:11.679278 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5c6a4697-f2ae-4e19-83f4-2d65ee22d313 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:11.679884 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5c6a4697-f2ae-4e19-83f4-2d65ee22d313 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:11.805408 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-38fb86fe-2243-4639-913c-c94583507168 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:11.814142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-38fb86fe-2243-4639-913c-c94583507168 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1366 microversion: 2.1 time: 0.468605 May 12 14:41:11.816807 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5c6a4697-f2ae-4e19-83f4-2d65ee22d313 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:11.820678 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 530/1078] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:11 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1366 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:11.834047 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5c6a4697-f2ae-4e19-83f4-2d65ee22d313 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1210 microversion: 2.1 time: 0.176091 May 12 14:41:11.844037 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 549/1079] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:11 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1210 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:41:12.279409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-be982939-2ff2-4999-87aa-0c4f8eb18bd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:12.280418 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-be982939-2ff2-4999-87aa-0c4f8eb18bd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:12.288015 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-be982939-2ff2-4999-87aa-0c4f8eb18bd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:12.288822 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-be982939-2ff2-4999-87aa-0c4f8eb18bd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:12.289712 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-be982939-2ff2-4999-87aa-0c4f8eb18bd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:12.290298 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-be982939-2ff2-4999-87aa-0c4f8eb18bd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:12.517178 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-be982939-2ff2-4999-87aa-0c4f8eb18bd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:12.536262 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-be982939-2ff2-4999-87aa-0c4f8eb18bd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:12.538846 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-be982939-2ff2-4999-87aa-0c4f8eb18bd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:12.541352 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-be982939-2ff2-4999-87aa-0c4f8eb18bd8 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.266598 May 12 14:41:12.544175 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 531/1080] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:12 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:41:12.834026 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-cd107865-85ea-4b49-9d1a-be8c4571f1bb tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:12.835634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-cd107865-85ea-4b49-9d1a-be8c4571f1bb tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:12.853007 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-dba6470b-4552-488b-81a8-030ae88ee009 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:12.853887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-dba6470b-4552-488b-81a8-030ae88ee009 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:12.863600 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cd107865-85ea-4b49-9d1a-be8c4571f1bb tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:12.864395 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cd107865-85ea-4b49-9d1a-be8c4571f1bb tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:12.865368 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cd107865-85ea-4b49-9d1a-be8c4571f1bb tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:12.865998 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cd107865-85ea-4b49-9d1a-be8c4571f1bb tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:12.866917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dba6470b-4552-488b-81a8-030ae88ee009 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:12.878546 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dba6470b-4552-488b-81a8-030ae88ee009 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:12.879618 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dba6470b-4552-488b-81a8-030ae88ee009 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:12.882020 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dba6470b-4552-488b-81a8-030ae88ee009 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:13.182250 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-cd107865-85ea-4b49-9d1a-be8c4571f1bb tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:13.198838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-cd107865-85ea-4b49-9d1a-be8c4571f1bb tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1366 microversion: 2.1 time: 0.368782 May 12 14:41:13.199521 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 550/1081] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:12 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:13.383600 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-dba6470b-4552-488b-81a8-030ae88ee009 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:13.395104 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-dba6470b-4552-488b-81a8-030ae88ee009 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1266 microversion: 2.1 time: 0.544289 May 12 14:41:13.395925 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 532/1082] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:12 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1266 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:13.561307 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a336097c-e214-4f29-a900-b26e61271082 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:13.561929 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a336097c-e214-4f29-a900-b26e61271082 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:13.567883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a336097c-e214-4f29-a900-b26e61271082 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:13.568344 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a336097c-e214-4f29-a900-b26e61271082 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:13.569131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a336097c-e214-4f29-a900-b26e61271082 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:13.569769 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a336097c-e214-4f29-a900-b26e61271082 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:13.803333 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a336097c-e214-4f29-a900-b26e61271082 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:13.814495 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a336097c-e214-4f29-a900-b26e61271082 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:13.816529 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a336097c-e214-4f29-a900-b26e61271082 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:13.818392 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a336097c-e214-4f29-a900-b26e61271082 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.261048 May 12 14:41:13.820808 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 551/1083] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:13 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:13.978175 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-a7621c94-fb9c-495f-84a7-3751ef252d06 req-4152b12c-05ba-48d9-a5f1-007a3a3a5356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a93128f-bc24-4529-8b60-6d661e9933bf", "tag": "80f0b63a-177b-495c-b004-f7919b935f84"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:14.001756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-a7621c94-fb9c-495f-84a7-3751ef252d06 req-4152b12c-05ba-48d9-a5f1-007a3a3a5356 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:14.003936 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-a7621c94-fb9c-495f-84a7-3751ef252d06 req-4152b12c-05ba-48d9-a5f1-007a3a3a5356 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:14.029290 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-a7621c94-fb9c-495f-84a7-3751ef252d06 req-4152b12c-05ba-48d9-a5f1-007a3a3a5356 service nova] Creating event network-changed:80f0b63a-177b-495c-b004-f7919b935f84 for instance 3a93128f-bc24-4529-8b60-6d661e9933bf on hv-cinder-77703 May 12 14:41:14.036048 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-a7621c94-fb9c-495f-84a7-3751ef252d06 req-4152b12c-05ba-48d9-a5f1-007a3a3a5356 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061315 May 12 14:41:14.037836 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 533/1084] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:14.216398 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-234f25ae-c54c-4f7a-9c5b-8b6de1968ab7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:14.217806 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-234f25ae-c54c-4f7a-9c5b-8b6de1968ab7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:14.234307 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-234f25ae-c54c-4f7a-9c5b-8b6de1968ab7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:14.234772 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-234f25ae-c54c-4f7a-9c5b-8b6de1968ab7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:14.237186 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-234f25ae-c54c-4f7a-9c5b-8b6de1968ab7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:14.239304 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-234f25ae-c54c-4f7a-9c5b-8b6de1968ab7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:14.414147 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-699a6be0-d2fb-40b0-8761-06bb39d95914 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:14.415187 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-699a6be0-d2fb-40b0-8761-06bb39d95914 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:14.427994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-699a6be0-d2fb-40b0-8761-06bb39d95914 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:14.436465 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-699a6be0-d2fb-40b0-8761-06bb39d95914 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:14.437985 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-699a6be0-d2fb-40b0-8761-06bb39d95914 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:14.438618 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-699a6be0-d2fb-40b0-8761-06bb39d95914 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:14.591006 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-234f25ae-c54c-4f7a-9c5b-8b6de1968ab7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:14.600293 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-234f25ae-c54c-4f7a-9c5b-8b6de1968ab7 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1366 microversion: 2.1 time: 0.389072 May 12 14:41:14.601518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 552/1085] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:14 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:14.607725 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-702ddfbc-95c8-4f36-b494-6c0eee7ee3d5 req-4e63013f-d221-4edf-a6ce-6b937a9a9915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b293e6a7-b82d-44db-af30-498fd91a7261", "name": "network-vif-plugged", "status": "completed", "tag": "72bdfac6-9a66-4d48-b364-b06fc90433ed"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:14.617849 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-702ddfbc-95c8-4f36-b494-6c0eee7ee3d5 req-4e63013f-d221-4edf-a6ce-6b937a9a9915 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:14.618832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-702ddfbc-95c8-4f36-b494-6c0eee7ee3d5 req-4e63013f-d221-4edf-a6ce-6b937a9a9915 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:14.632930 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-702ddfbc-95c8-4f36-b494-6c0eee7ee3d5 req-4e63013f-d221-4edf-a6ce-6b937a9a9915 service nova] Creating event network-vif-plugged:72bdfac6-9a66-4d48-b364-b06fc90433ed for instance b293e6a7-b82d-44db-af30-498fd91a7261 on hv-cinder-77703 May 12 14:41:14.648541 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-702ddfbc-95c8-4f36-b494-6c0eee7ee3d5 req-4e63013f-d221-4edf-a6ce-6b937a9a9915 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045419 May 12 14:41:14.654663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 553/1086] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:14.790141 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-699a6be0-d2fb-40b0-8761-06bb39d95914 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:14.801890 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-699a6be0-d2fb-40b0-8761-06bb39d95914 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1266 microversion: 2.1 time: 0.392236 May 12 14:41:14.802494 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 534/1087] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:14 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1266 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:14.840737 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8449bd16-a998-4457-b13d-a16b058f9e28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:14.841459 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8449bd16-a998-4457-b13d-a16b058f9e28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:14.851140 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8449bd16-a998-4457-b13d-a16b058f9e28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:14.851600 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8449bd16-a998-4457-b13d-a16b058f9e28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:14.852693 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8449bd16-a998-4457-b13d-a16b058f9e28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:14.853140 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8449bd16-a998-4457-b13d-a16b058f9e28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:15.064391 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8449bd16-a998-4457-b13d-a16b058f9e28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:15.075661 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8449bd16-a998-4457-b13d-a16b058f9e28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:15.077364 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8449bd16-a998-4457-b13d-a16b058f9e28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:15.078609 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8449bd16-a998-4457-b13d-a16b058f9e28 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.244590 May 12 14:41:15.089470 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 554/1088] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:14 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:15.617891 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1ffd5eb0-a8e2-40dd-8f81-9bcaf071699e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:15.618944 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1ffd5eb0-a8e2-40dd-8f81-9bcaf071699e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:15.626493 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ffd5eb0-a8e2-40dd-8f81-9bcaf071699e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:15.626956 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ffd5eb0-a8e2-40dd-8f81-9bcaf071699e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:15.627789 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ffd5eb0-a8e2-40dd-8f81-9bcaf071699e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:15.628232 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ffd5eb0-a8e2-40dd-8f81-9bcaf071699e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:15.810851 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1ffd5eb0-a8e2-40dd-8f81-9bcaf071699e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:15.818398 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1ffd5eb0-a8e2-40dd-8f81-9bcaf071699e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1366 microversion: 2.1 time: 0.204387 May 12 14:41:15.818596 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2a1171da-8e3a-44b7-a395-5d2812583d31 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:15.819136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2a1171da-8e3a-44b7-a395-5d2812583d31 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:15.824188 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 535/1089] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:15 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:15.827616 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2a1171da-8e3a-44b7-a395-5d2812583d31 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:15.828840 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2a1171da-8e3a-44b7-a395-5d2812583d31 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:15.829791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2a1171da-8e3a-44b7-a395-5d2812583d31 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:15.830449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2a1171da-8e3a-44b7-a395-5d2812583d31 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:16.074053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2a1171da-8e3a-44b7-a395-5d2812583d31 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:16.082791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2a1171da-8e3a-44b7-a395-5d2812583d31 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1266 microversion: 2.1 time: 0.268743 May 12 14:41:16.084141 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 555/1090] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:15 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:16.097771 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c3a107c5-a59c-45af-9190-7d931499af43 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:16.098587 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c3a107c5-a59c-45af-9190-7d931499af43 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:16.106840 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c3a107c5-a59c-45af-9190-7d931499af43 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:16.110876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c3a107c5-a59c-45af-9190-7d931499af43 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:16.112003 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c3a107c5-a59c-45af-9190-7d931499af43 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:16.112667 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c3a107c5-a59c-45af-9190-7d931499af43 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:16.278296 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c3a107c5-a59c-45af-9190-7d931499af43 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:16.295488 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c3a107c5-a59c-45af-9190-7d931499af43 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:16.297025 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c3a107c5-a59c-45af-9190-7d931499af43 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:16.298215 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c3a107c5-a59c-45af-9190-7d931499af43 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.204890 May 12 14:41:16.304260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 536/1091] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:16 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:16.760703 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b07a5daa-3438-41e1-b6f8-76f51b7f90dd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Action: 'create', calling method: .version_select at 0x7f5b26930040>, body: {"keypair": {"name": "tempest-keypair-1984954472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDp6YNVilEL2xRtQrKUpmfxQ+JO+U3Sb65YCxHEE1ol+/ui1g6c6/UzqjEh3xrvt/7wGjU9Vz0G75IY7gNjJB038IenA1tCVW/SxXR4tAYnCfy6HjEuTlm8UrCMF6vbaUQ=="}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:16.775157 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-b07a5daa-3438-41e1-b6f8-76f51b7f90dd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Getting quotas for project 38fdbe6cacb8487087950884b752b21d. Resources: {'key_pairs'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:41:16.779462 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-b07a5daa-3438-41e1-b6f8-76f51b7f90dd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Getting quotas for user 5ea3990cf736495ea612f1f5ed4f8674 and project 38fdbe6cacb8487087950884b752b21d. Resources: {'key_pairs'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:41:16.801432 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b07a5daa-3438-41e1-b6f8-76f51b7f90dd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.153755 May 12 14:41:16.802076 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 556/1092] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 12 14:41:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:16.837051 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a24c7c4f-d95c-49ff-8381-78c03eb10093 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:16.837671 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a24c7c4f-d95c-49ff-8381-78c03eb10093 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:16.844180 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a24c7c4f-d95c-49ff-8381-78c03eb10093 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:16.844634 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a24c7c4f-d95c-49ff-8381-78c03eb10093 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:16.845399 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a24c7c4f-d95c-49ff-8381-78c03eb10093 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:16.845851 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a24c7c4f-d95c-49ff-8381-78c03eb10093 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:17.100967 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a24c7c4f-d95c-49ff-8381-78c03eb10093 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:17.107826 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ab3751fd-783a-4bc0-8b59-a6fb50bd6e74 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:17.109601 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a24c7c4f-d95c-49ff-8381-78c03eb10093 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1366 microversion: 2.1 time: 0.276550 May 12 14:41:17.109770 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ab3751fd-783a-4bc0-8b59-a6fb50bd6e74 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:17.119691 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ab3751fd-783a-4bc0-8b59-a6fb50bd6e74 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:17.119691 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ab3751fd-783a-4bc0-8b59-a6fb50bd6e74 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:17.119691 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ab3751fd-783a-4bc0-8b59-a6fb50bd6e74 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:17.119691 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ab3751fd-783a-4bc0-8b59-a6fb50bd6e74 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:17.120463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 537/1093] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:16 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:17.317409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3ef1c579-2194-44b9-ae21-bea39e4cc145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:17.318186 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3ef1c579-2194-44b9-ae21-bea39e4cc145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:17.329434 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3ef1c579-2194-44b9-ae21-bea39e4cc145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:17.331959 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3ef1c579-2194-44b9-ae21-bea39e4cc145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:17.332992 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3ef1c579-2194-44b9-ae21-bea39e4cc145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:17.334940 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3ef1c579-2194-44b9-ae21-bea39e4cc145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:17.596863 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3ef1c579-2194-44b9-ae21-bea39e4cc145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:17.606687 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3ef1c579-2194-44b9-ae21-bea39e4cc145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:17.608682 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3ef1c579-2194-44b9-ae21-bea39e4cc145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:17.610134 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3ef1c579-2194-44b9-ae21-bea39e4cc145 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.297841 May 12 14:41:17.610852 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 538/1094] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:17 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:41:17.669960 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ab3751fd-783a-4bc0-8b59-a6fb50bd6e74 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:17.678631 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ab3751fd-783a-4bc0-8b59-a6fb50bd6e74 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1266 microversion: 2.1 time: 0.582034 May 12 14:41:17.682482 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 557/1095] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:17 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1266 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:18.126996 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3e040943-dd2f-4841-84e1-c4cdbc611b58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:18.128156 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3e040943-dd2f-4841-84e1-c4cdbc611b58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:18.135185 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3e040943-dd2f-4841-84e1-c4cdbc611b58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:18.135859 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3e040943-dd2f-4841-84e1-c4cdbc611b58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:18.138374 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3e040943-dd2f-4841-84e1-c4cdbc611b58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:18.138983 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3e040943-dd2f-4841-84e1-c4cdbc611b58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:18.176416 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-338294865", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6aa87a35-26a0-490d-b024-c2e7f7422864"}], "security_groups": [{"name": "tempest-securitygroup--2022656066"}], "key_name": "tempest-keypair-1984954472", "user_data": "}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:18.422326 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.network.neutron [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] validate_networks() for [('6aa87a35-26a0-490d-b024-c2e7f7422864', None, None, None, None, None)] {{(pid=118217) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:41:18.464355 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3e040943-dd2f-4841-84e1-c4cdbc611b58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:18.471769 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3e040943-dd2f-4841-84e1-c4cdbc611b58 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1366 microversion: 2.1 time: 0.349077 May 12 14:41:18.472348 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 539/1096] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:18 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:18.630825 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4c4fb7d5-0fd2-449a-81e8-b19a6bffcea3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:18.631497 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4c4fb7d5-0fd2-449a-81e8-b19a6bffcea3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:18.638988 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c4fb7d5-0fd2-449a-81e8-b19a6bffcea3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:18.639732 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c4fb7d5-0fd2-449a-81e8-b19a6bffcea3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:18.641538 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c4fb7d5-0fd2-449a-81e8-b19a6bffcea3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:18.642175 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4c4fb7d5-0fd2-449a-81e8-b19a6bffcea3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:18.884340 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4c4fb7d5-0fd2-449a-81e8-b19a6bffcea3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:18.895633 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4c4fb7d5-0fd2-449a-81e8-b19a6bffcea3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:18.897550 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4c4fb7d5-0fd2-449a-81e8-b19a6bffcea3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:18.899273 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4c4fb7d5-0fd2-449a-81e8-b19a6bffcea3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1745 microversion: 2.20 time: 0.274518 May 12 14:41:18.900026 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 540/1097] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:18 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1745 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:41:18.909898 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-407c45dc-9a00-47fc-87ea-f4e1f5d4eb3e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:18.910880 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-407c45dc-9a00-47fc-87ea-f4e1f5d4eb3e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:18.919191 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-407c45dc-9a00-47fc-87ea-f4e1f5d4eb3e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:18.919923 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-407c45dc-9a00-47fc-87ea-f4e1f5d4eb3e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:18.920722 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-407c45dc-9a00-47fc-87ea-f4e1f5d4eb3e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:18.921326 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-407c45dc-9a00-47fc-87ea-f4e1f5d4eb3e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:19.025836 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Flavor limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:41:19.026352 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Image limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:41:19.026914 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Flavor pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:41:19.028089 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Image pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:41:19.028775 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:41:19.048410 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:19.049170 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:19.050189 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:19.050838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:19.075767 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Getting quotas for project 38fdbe6cacb8487087950884b752b21d. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:41:19.080370 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Getting quotas for user 5ea3990cf736495ea612f1f5ed4f8674 and project 38fdbe6cacb8487087950884b752b21d. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:41:19.094166 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Going to run 1 instances... {{(pid=118217) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:41:19.097102 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:41:19.151525 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ae756662-80cf-4cbb-85ee-79f01bb16d01 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.979192 May 12 14:41:19.152769 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 558/1098] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:41:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:41:19.167802 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-06b248d4-8bfd-42d7-873c-9680237c68ba tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:19.168811 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-06b248d4-8bfd-42d7-873c-9680237c68ba tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:19.173372 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-407c45dc-9a00-47fc-87ea-f4e1f5d4eb3e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:19.181627 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-407c45dc-9a00-47fc-87ea-f4e1f5d4eb3e tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1266 microversion: 2.1 time: 0.280023 May 12 14:41:19.184174 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 541/1099] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:18 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:19.251810 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-06b248d4-8bfd-42d7-873c-9680237c68ba tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:19.263457 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-06b248d4-8bfd-42d7-873c-9680237c68ba tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1237 microversion: 2.1 time: 0.103301 May 12 14:41:19.273456 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 559/1100] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:19 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1237 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:19.488021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-42d4cefd-4524-41a2-981e-b13ba60b3c0c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:19.488722 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-42d4cefd-4524-41a2-981e-b13ba60b3c0c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:19.503160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-42d4cefd-4524-41a2-981e-b13ba60b3c0c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:19.503614 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-42d4cefd-4524-41a2-981e-b13ba60b3c0c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:19.504425 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-42d4cefd-4524-41a2-981e-b13ba60b3c0c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:19.504866 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-42d4cefd-4524-41a2-981e-b13ba60b3c0c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:19.775137 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-42d4cefd-4524-41a2-981e-b13ba60b3c0c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:19.783956 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-42d4cefd-4524-41a2-981e-b13ba60b3c0c tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1556 microversion: 2.1 time: 0.299653 May 12 14:41:19.784694 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 542/1101] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:19 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1556 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:19.800858 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-35db7326-28d7-4d82-aa69-4fee8c7c988a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:19.801368 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-35db7326-28d7-4d82-aa69-4fee8c7c988a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:19.808312 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-35db7326-28d7-4d82-aa69-4fee8c7c988a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:19.809348 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-35db7326-28d7-4d82-aa69-4fee8c7c988a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:19.810186 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-35db7326-28d7-4d82-aa69-4fee8c7c988a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:19.812507 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-35db7326-28d7-4d82-aa69-4fee8c7c988a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:19.898771 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-35db7326-28d7-4d82-aa69-4fee8c7c988a tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101648 May 12 14:41:19.899431 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 560/1102] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 12 14:41:19 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:19.922349 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4164b3f8-c3c1-4c3d-b7ec-f8558edd5dc3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:19.923383 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4164b3f8-c3c1-4c3d-b7ec-f8558edd5dc3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:19.930860 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4164b3f8-c3c1-4c3d-b7ec-f8558edd5dc3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:19.931397 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4164b3f8-c3c1-4c3d-b7ec-f8558edd5dc3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:19.932207 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4164b3f8-c3c1-4c3d-b7ec-f8558edd5dc3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:19.932655 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4164b3f8-c3c1-4c3d-b7ec-f8558edd5dc3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:20.204970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4164b3f8-c3c1-4c3d-b7ec-f8558edd5dc3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:20.206581 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-dac9c36e-46ae-45a5-bd08-d7ef442ed319 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:20.207785 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-dac9c36e-46ae-45a5-bd08-d7ef442ed319 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:20.216544 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4164b3f8-c3c1-4c3d-b7ec-f8558edd5dc3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:20.218351 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4164b3f8-c3c1-4c3d-b7ec-f8558edd5dc3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:20.219543 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dac9c36e-46ae-45a5-bd08-d7ef442ed319 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:20.220183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dac9c36e-46ae-45a5-bd08-d7ef442ed319 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:20.221168 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dac9c36e-46ae-45a5-bd08-d7ef442ed319 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:20.221774 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dac9c36e-46ae-45a5-bd08-d7ef442ed319 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:20.223163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4164b3f8-c3c1-4c3d-b7ec-f8558edd5dc3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1745 microversion: 2.20 time: 0.306027 May 12 14:41:20.241450 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 543/1103] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:19 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1745 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:20.280833 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-531c9ef2-2139-446a-ab9d-30c48313c22b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:20.281919 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-531c9ef2-2139-446a-ab9d-30c48313c22b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:20.290114 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-531c9ef2-2139-446a-ab9d-30c48313c22b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:20.290949 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-531c9ef2-2139-446a-ab9d-30c48313c22b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:20.291986 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-531c9ef2-2139-446a-ab9d-30c48313c22b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:20.292643 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-531c9ef2-2139-446a-ab9d-30c48313c22b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:20.407338 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-531c9ef2-2139-446a-ab9d-30c48313c22b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:20.415290 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-531c9ef2-2139-446a-ab9d-30c48313c22b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1289 microversion: 2.1 time: 0.138931 May 12 14:41:20.416490 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 544/1104] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:20 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1289 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:20.658645 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-dac9c36e-46ae-45a5-bd08-d7ef442ed319 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:20.671364 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-dac9c36e-46ae-45a5-bd08-d7ef442ed319 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1266 microversion: 2.1 time: 0.471743 May 12 14:41:20.673413 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 561/1105] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:20 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1266 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:21.245686 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-13f53479-8bc6-4729-8ee2-9764b06b4fa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:21.247086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-13f53479-8bc6-4729-8ee2-9764b06b4fa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:21.253723 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-13f53479-8bc6-4729-8ee2-9764b06b4fa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:21.254287 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-13f53479-8bc6-4729-8ee2-9764b06b4fa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:21.255785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-13f53479-8bc6-4729-8ee2-9764b06b4fa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:21.256328 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-13f53479-8bc6-4729-8ee2-9764b06b4fa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:21.432956 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bc21048f-822a-450b-8c3c-7e820a416170 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:21.433694 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bc21048f-822a-450b-8c3c-7e820a416170 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:21.439967 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bc21048f-822a-450b-8c3c-7e820a416170 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:21.440428 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bc21048f-822a-450b-8c3c-7e820a416170 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:21.441245 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bc21048f-822a-450b-8c3c-7e820a416170 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:21.441686 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bc21048f-822a-450b-8c3c-7e820a416170 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:21.560533 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bc21048f-822a-450b-8c3c-7e820a416170 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:21.567862 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bc21048f-822a-450b-8c3c-7e820a416170 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1295 microversion: 2.1 time: 0.138701 May 12 14:41:21.568439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 562/1106] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:21 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1295 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:41:21.585640 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-13f53479-8bc6-4729-8ee2-9764b06b4fa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:21.594362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-13f53479-8bc6-4729-8ee2-9764b06b4fa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:21.595950 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-13f53479-8bc6-4729-8ee2-9764b06b4fa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:21.597138 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-13f53479-8bc6-4729-8ee2-9764b06b4fa6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1745 microversion: 2.20 time: 0.355792 May 12 14:41:21.597741 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 545/1107] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:21 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1745 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:21.689492 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1d28ab87-6a0e-48d5-8750-6bf78a519982 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:21.690021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1d28ab87-6a0e-48d5-8750-6bf78a519982 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:21.695959 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d28ab87-6a0e-48d5-8750-6bf78a519982 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:21.696418 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d28ab87-6a0e-48d5-8750-6bf78a519982 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:21.697194 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d28ab87-6a0e-48d5-8750-6bf78a519982 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:21.697633 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d28ab87-6a0e-48d5-8750-6bf78a519982 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:21.930151 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-219454be-1547-40e7-8e53-8e40326ff61b req-d50dc6ad-8265-4d47-9b7a-6643a2b16b4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b293e6a7-b82d-44db-af30-498fd91a7261", "tag": "72bdfac6-9a66-4d48-b364-b06fc90433ed"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:21.939189 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-219454be-1547-40e7-8e53-8e40326ff61b req-d50dc6ad-8265-4d47-9b7a-6643a2b16b4f service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:21.940057 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-219454be-1547-40e7-8e53-8e40326ff61b req-d50dc6ad-8265-4d47-9b7a-6643a2b16b4f service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:21.953955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-219454be-1547-40e7-8e53-8e40326ff61b req-d50dc6ad-8265-4d47-9b7a-6643a2b16b4f service nova] Creating event network-changed:72bdfac6-9a66-4d48-b364-b06fc90433ed for instance b293e6a7-b82d-44db-af30-498fd91a7261 on hv-cinder-77703 May 12 14:41:21.959587 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-219454be-1547-40e7-8e53-8e40326ff61b req-d50dc6ad-8265-4d47-9b7a-6643a2b16b4f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033150 May 12 14:41:21.960934 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 546/1108] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:41:21.978200 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1d28ab87-6a0e-48d5-8750-6bf78a519982 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:21.985941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1d28ab87-6a0e-48d5-8750-6bf78a519982 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1266 microversion: 2.1 time: 0.300417 May 12 14:41:21.986825 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 563/1109] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:21 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1266 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:22.335667 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-8ad4e7ce-6ca6-4ef7-9e6d-e9d655c7835a req-e7d21a18-884e-4ed9-a277-b3ec677e3bcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533a547e-b44f-4a33-8725-24b323556322", "name": "network-vif-plugged", "status": "completed", "tag": "152a3c94-4ce4-4682-a2c1-1ad44f9d899e"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:22.347190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-8ad4e7ce-6ca6-4ef7-9e6d-e9d655c7835a req-e7d21a18-884e-4ed9-a277-b3ec677e3bcc service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:22.347944 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-8ad4e7ce-6ca6-4ef7-9e6d-e9d655c7835a req-e7d21a18-884e-4ed9-a277-b3ec677e3bcc service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:22.360954 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-8ad4e7ce-6ca6-4ef7-9e6d-e9d655c7835a req-e7d21a18-884e-4ed9-a277-b3ec677e3bcc service nova] Creating event network-vif-plugged:152a3c94-4ce4-4682-a2c1-1ad44f9d899e for instance 533a547e-b44f-4a33-8725-24b323556322 on hv-cinder-77703 May 12 14:41:22.366284 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-8ad4e7ce-6ca6-4ef7-9e6d-e9d655c7835a req-e7d21a18-884e-4ed9-a277-b3ec677e3bcc service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035110 May 12 14:41:22.367544 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 547/1110] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:22.584794 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5ed3d549-0a15-4b2a-8aba-908e894291ea tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:22.585417 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5ed3d549-0a15-4b2a-8aba-908e894291ea tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:22.591795 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ed3d549-0a15-4b2a-8aba-908e894291ea tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:22.592254 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ed3d549-0a15-4b2a-8aba-908e894291ea tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:22.593032 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ed3d549-0a15-4b2a-8aba-908e894291ea tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:22.593472 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5ed3d549-0a15-4b2a-8aba-908e894291ea tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:22.616756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2b5676ae-e82e-47c6-b8b2-e9a4af114186 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:22.617543 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2b5676ae-e82e-47c6-b8b2-e9a4af114186 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:22.624955 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2b5676ae-e82e-47c6-b8b2-e9a4af114186 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:22.634568 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2b5676ae-e82e-47c6-b8b2-e9a4af114186 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:22.635480 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2b5676ae-e82e-47c6-b8b2-e9a4af114186 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:22.635924 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2b5676ae-e82e-47c6-b8b2-e9a4af114186 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:22.768749 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5ed3d549-0a15-4b2a-8aba-908e894291ea tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:22.781125 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5ed3d549-0a15-4b2a-8aba-908e894291ea tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1363 microversion: 2.1 time: 0.200070 May 12 14:41:22.782154 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 564/1111] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:22 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:22.803612 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2b5676ae-e82e-47c6-b8b2-e9a4af114186 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:22.812061 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2b5676ae-e82e-47c6-b8b2-e9a4af114186 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:22.813599 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-2b5676ae-e82e-47c6-b8b2-e9a4af114186 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:22.814769 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2b5676ae-e82e-47c6-b8b2-e9a4af114186 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1745 microversion: 2.20 time: 0.202872 May 12 14:41:22.815371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 548/1112] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:22 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1745 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:41:23.004416 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-00a8ece1-5bab-499b-8331-61dae01252bd tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:23.005378 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-00a8ece1-5bab-499b-8331-61dae01252bd tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:23.012466 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-00a8ece1-5bab-499b-8331-61dae01252bd tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:23.013025 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-00a8ece1-5bab-499b-8331-61dae01252bd tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:23.014079 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-00a8ece1-5bab-499b-8331-61dae01252bd tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:23.014635 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-00a8ece1-5bab-499b-8331-61dae01252bd tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:23.221432 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-00a8ece1-5bab-499b-8331-61dae01252bd tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:23.228917 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-00a8ece1-5bab-499b-8331-61dae01252bd tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1266 microversion: 2.1 time: 0.228528 May 12 14:41:23.229488 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 565/1113] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:22 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:23.797914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-abb245b0-acc8-4e73-81b5-6e3523a45f55 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:23.798537 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-abb245b0-acc8-4e73-81b5-6e3523a45f55 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:23.804950 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-abb245b0-acc8-4e73-81b5-6e3523a45f55 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:23.805452 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-abb245b0-acc8-4e73-81b5-6e3523a45f55 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:23.806232 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-abb245b0-acc8-4e73-81b5-6e3523a45f55 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:23.806687 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-abb245b0-acc8-4e73-81b5-6e3523a45f55 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:23.833528 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2c1f649f-5f4d-40b8-961d-c24c7808bf75 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:23.834152 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2c1f649f-5f4d-40b8-961d-c24c7808bf75 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:23.844022 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2c1f649f-5f4d-40b8-961d-c24c7808bf75 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:23.845252 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2c1f649f-5f4d-40b8-961d-c24c7808bf75 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:23.845995 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2c1f649f-5f4d-40b8-961d-c24c7808bf75 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:23.846681 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2c1f649f-5f4d-40b8-961d-c24c7808bf75 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:24.019167 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-abb245b0-acc8-4e73-81b5-6e3523a45f55 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:24.027597 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-abb245b0-acc8-4e73-81b5-6e3523a45f55 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1363 microversion: 2.1 time: 0.233209 May 12 14:41:24.028645 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 549/1114] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:23 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:24.036488 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-0f3ba196-183c-420b-a48a-65ff05806fd4 req-b99f2c96-4159-4e4f-8986-64c0180e5362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b68e00-a067-4696-b0d5-2cc050569c72", "tag": "43202a5c-79c7-46ed-8988-a1031b1e8e9a"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:24.050416 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2c1f649f-5f4d-40b8-961d-c24c7808bf75 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:24.051059 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-0f3ba196-183c-420b-a48a-65ff05806fd4 req-b99f2c96-4159-4e4f-8986-64c0180e5362 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:24.051830 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-0f3ba196-183c-420b-a48a-65ff05806fd4 req-b99f2c96-4159-4e4f-8986-64c0180e5362 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:24.058454 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2c1f649f-5f4d-40b8-961d-c24c7808bf75 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:24.060590 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-2c1f649f-5f4d-40b8-961d-c24c7808bf75 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:24.061769 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2c1f649f-5f4d-40b8-961d-c24c7808bf75 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1745 microversion: 2.20 time: 0.232652 May 12 14:41:24.062346 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 566/1115] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:23 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1745 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:41:24.072225 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-0f3ba196-183c-420b-a48a-65ff05806fd4 req-b99f2c96-4159-4e4f-8986-64c0180e5362 service nova] Creating event network-changed:43202a5c-79c7-46ed-8988-a1031b1e8e9a for instance b4b68e00-a067-4696-b0d5-2cc050569c72 on hv-cinder-77703 May 12 14:41:24.080539 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-0f3ba196-183c-420b-a48a-65ff05806fd4 req-b99f2c96-4159-4e4f-8986-64c0180e5362 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050146 May 12 14:41:24.081846 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 550/1116] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:24.246171 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-97d4cc5e-5e03-4f09-a056-6fb6be3c01a5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:24.246759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-97d4cc5e-5e03-4f09-a056-6fb6be3c01a5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:24.252991 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97d4cc5e-5e03-4f09-a056-6fb6be3c01a5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:24.253626 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97d4cc5e-5e03-4f09-a056-6fb6be3c01a5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:24.254463 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97d4cc5e-5e03-4f09-a056-6fb6be3c01a5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:24.255004 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-97d4cc5e-5e03-4f09-a056-6fb6be3c01a5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:24.568992 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-97d4cc5e-5e03-4f09-a056-6fb6be3c01a5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:24.576405 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-97d4cc5e-5e03-4f09-a056-6fb6be3c01a5 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1266 microversion: 2.1 time: 0.334489 May 12 14:41:24.576983 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 567/1117] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:24 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:25.046800 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4799d042-794a-49c8-bf75-7f017931d0df tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:25.047814 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4799d042-794a-49c8-bf75-7f017931d0df tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:25.054337 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4799d042-794a-49c8-bf75-7f017931d0df tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:25.054781 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4799d042-794a-49c8-bf75-7f017931d0df tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:25.055706 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4799d042-794a-49c8-bf75-7f017931d0df tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:25.056148 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4799d042-794a-49c8-bf75-7f017931d0df tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:25.082748 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f4dbeb67-f11a-4dd1-9d54-55ed1eab7c88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:25.084509 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f4dbeb67-f11a-4dd1-9d54-55ed1eab7c88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:25.093299 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f4dbeb67-f11a-4dd1-9d54-55ed1eab7c88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:25.094165 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f4dbeb67-f11a-4dd1-9d54-55ed1eab7c88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:25.095063 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f4dbeb67-f11a-4dd1-9d54-55ed1eab7c88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:25.095759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f4dbeb67-f11a-4dd1-9d54-55ed1eab7c88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:25.467376 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f4dbeb67-f11a-4dd1-9d54-55ed1eab7c88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:25.470647 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-4799d042-794a-49c8-bf75-7f017931d0df tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:25.475610 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f4dbeb67-f11a-4dd1-9d54-55ed1eab7c88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:25.477129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f4dbeb67-f11a-4dd1-9d54-55ed1eab7c88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:25.478300 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f4dbeb67-f11a-4dd1-9d54-55ed1eab7c88 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1745 microversion: 2.20 time: 0.402162 May 12 14:41:25.478618 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4799d042-794a-49c8-bf75-7f017931d0df tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1363 microversion: 2.1 time: 0.437570 May 12 14:41:25.478872 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 568/1118] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:25 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1745 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:41:25.479580 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 551/1119] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:25 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:25.593848 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f226dcae-909b-4e49-b994-9c0226465e7a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:25.594475 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f226dcae-909b-4e49-b994-9c0226465e7a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:25.600392 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f226dcae-909b-4e49-b994-9c0226465e7a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:25.600993 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f226dcae-909b-4e49-b994-9c0226465e7a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:25.601833 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f226dcae-909b-4e49-b994-9c0226465e7a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:25.602313 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f226dcae-909b-4e49-b994-9c0226465e7a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:25.764623 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f226dcae-909b-4e49-b994-9c0226465e7a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:25.772300 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f226dcae-909b-4e49-b994-9c0226465e7a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1266 microversion: 2.1 time: 0.183019 May 12 14:41:25.772874 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 569/1120] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:25 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:26.495978 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8e6c0956-eb29-4c9a-bbdb-c912ff79b0be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:26.496563 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-8e6c0956-eb29-4c9a-bbdb-c912ff79b0be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:26.497522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7f11a8b5-c561-41b1-8670-70a38b36ea0c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:26.498144 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7f11a8b5-c561-41b1-8670-70a38b36ea0c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:26.502575 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8e6c0956-eb29-4c9a-bbdb-c912ff79b0be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:26.503049 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8e6c0956-eb29-4c9a-bbdb-c912ff79b0be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:26.503831 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8e6c0956-eb29-4c9a-bbdb-c912ff79b0be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:26.504338 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7f11a8b5-c561-41b1-8670-70a38b36ea0c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:26.504451 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8e6c0956-eb29-4c9a-bbdb-c912ff79b0be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:26.504791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7f11a8b5-c561-41b1-8670-70a38b36ea0c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:26.505597 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7f11a8b5-c561-41b1-8670-70a38b36ea0c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:26.506041 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7f11a8b5-c561-41b1-8670-70a38b36ea0c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:26.691116 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8e6c0956-eb29-4c9a-bbdb-c912ff79b0be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:26.697971 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7f11a8b5-c561-41b1-8670-70a38b36ea0c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:26.698341 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8e6c0956-eb29-4c9a-bbdb-c912ff79b0be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1363 microversion: 2.1 time: 0.206736 May 12 14:41:26.699177 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 552/1121] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:26 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:26.707931 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7f11a8b5-c561-41b1-8670-70a38b36ea0c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:26.709460 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7f11a8b5-c561-41b1-8670-70a38b36ea0c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:26.710641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7f11a8b5-c561-41b1-8670-70a38b36ea0c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1745 microversion: 2.20 time: 0.217349 May 12 14:41:26.711231 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 570/1122] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:26 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1745 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:41:26.789586 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-85b2fc68-556e-48cb-b33e-12b7693faa2c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:26.790209 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-85b2fc68-556e-48cb-b33e-12b7693faa2c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:26.796142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-85b2fc68-556e-48cb-b33e-12b7693faa2c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:26.796601 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-85b2fc68-556e-48cb-b33e-12b7693faa2c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:26.797388 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-85b2fc68-556e-48cb-b33e-12b7693faa2c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:26.797946 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-85b2fc68-556e-48cb-b33e-12b7693faa2c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:26.873590 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-2930b365-b133-49a9-85a8-e28775177cff req-fb870ec2-9980-4b64-8a3b-7612eda00331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a93128f-bc24-4529-8b60-6d661e9933bf", "name": "network-vif-plugged", "status": "completed", "tag": "80f0b63a-177b-495c-b004-f7919b935f84"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:26.883117 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-2930b365-b133-49a9-85a8-e28775177cff req-fb870ec2-9980-4b64-8a3b-7612eda00331 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:26.883932 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-2930b365-b133-49a9-85a8-e28775177cff req-fb870ec2-9980-4b64-8a3b-7612eda00331 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:26.898784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-2930b365-b133-49a9-85a8-e28775177cff req-fb870ec2-9980-4b64-8a3b-7612eda00331 service nova] Creating event network-vif-plugged:80f0b63a-177b-495c-b004-f7919b935f84 for instance 3a93128f-bc24-4529-8b60-6d661e9933bf on hv-cinder-77703 May 12 14:41:26.905315 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-2930b365-b133-49a9-85a8-e28775177cff req-fb870ec2-9980-4b64-8a3b-7612eda00331 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036833 May 12 14:41:26.905934 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 571/1123] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:26.934760 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-85b2fc68-556e-48cb-b33e-12b7693faa2c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:26.942381 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-85b2fc68-556e-48cb-b33e-12b7693faa2c tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1266 microversion: 2.1 time: 0.156649 May 12 14:41:26.942957 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 553/1124] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:26 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:27.716445 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b266f1e3-6c91-4dd7-a770-1f95aeec8756 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:27.717148 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b266f1e3-6c91-4dd7-a770-1f95aeec8756 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:27.723326 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b266f1e3-6c91-4dd7-a770-1f95aeec8756 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:27.723788 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b266f1e3-6c91-4dd7-a770-1f95aeec8756 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:27.724558 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b266f1e3-6c91-4dd7-a770-1f95aeec8756 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:27.724999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b266f1e3-6c91-4dd7-a770-1f95aeec8756 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:27.866584 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ff1085eb-20a9-4dee-a797-006ff6b63e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:27.867231 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ff1085eb-20a9-4dee-a797-006ff6b63e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:27.870894 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b266f1e3-6c91-4dd7-a770-1f95aeec8756 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:27.873934 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff1085eb-20a9-4dee-a797-006ff6b63e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:27.874386 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff1085eb-20a9-4dee-a797-006ff6b63e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:27.875194 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff1085eb-20a9-4dee-a797-006ff6b63e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:27.875635 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff1085eb-20a9-4dee-a797-006ff6b63e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:27.878832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b266f1e3-6c91-4dd7-a770-1f95aeec8756 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1363 microversion: 2.1 time: 0.167040 May 12 14:41:27.879506 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 572/1125] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:27 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:27.959809 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b2f14d39-fbd7-4946-bb11-084b98837bac tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:27.960438 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b2f14d39-fbd7-4946-bb11-084b98837bac tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:27.967316 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b2f14d39-fbd7-4946-bb11-084b98837bac tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:27.967714 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b2f14d39-fbd7-4946-bb11-084b98837bac tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:27.968492 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b2f14d39-fbd7-4946-bb11-084b98837bac tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:27.968927 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b2f14d39-fbd7-4946-bb11-084b98837bac tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:28.004989 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ff1085eb-20a9-4dee-a797-006ff6b63e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:28.014237 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ff1085eb-20a9-4dee-a797-006ff6b63e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:28.015075 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ff1085eb-20a9-4dee-a797-006ff6b63e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:28.015630 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ff1085eb-20a9-4dee-a797-006ff6b63e82 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1745 microversion: 2.20 time: 0.290932 May 12 14:41:28.016394 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 554/1126] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:27 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1745 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:28.103743 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b2f14d39-fbd7-4946-bb11-084b98837bac tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:28.111626 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b2f14d39-fbd7-4946-bb11-084b98837bac tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1266 microversion: 2.1 time: 0.155839 May 12 14:41:28.112218 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 573/1127] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:27 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:41:28.895852 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e63deb7b-e25d-4ca5-a98b-4ba29ee15b24 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:28.896472 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e63deb7b-e25d-4ca5-a98b-4ba29ee15b24 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:28.905959 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e63deb7b-e25d-4ca5-a98b-4ba29ee15b24 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:28.906683 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e63deb7b-e25d-4ca5-a98b-4ba29ee15b24 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:28.907977 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e63deb7b-e25d-4ca5-a98b-4ba29ee15b24 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:28.908730 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e63deb7b-e25d-4ca5-a98b-4ba29ee15b24 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:29.036934 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7a36288e-30c1-4933-a250-334a3baf6a08 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:29.037945 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7a36288e-30c1-4933-a250-334a3baf6a08 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:29.045381 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7a36288e-30c1-4933-a250-334a3baf6a08 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:29.046222 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7a36288e-30c1-4933-a250-334a3baf6a08 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:29.047396 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7a36288e-30c1-4933-a250-334a3baf6a08 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:29.047903 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7a36288e-30c1-4933-a250-334a3baf6a08 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:29.100965 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e63deb7b-e25d-4ca5-a98b-4ba29ee15b24 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:29.109441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e63deb7b-e25d-4ca5-a98b-4ba29ee15b24 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1363 microversion: 2.1 time: 0.217457 May 12 14:41:29.117366 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 555/1128] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:28 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:29.130301 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a0e7f249-d128-44a9-91e1-ff5cae97cb87 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:29.131712 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a0e7f249-d128-44a9-91e1-ff5cae97cb87 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:29.142888 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a0e7f249-d128-44a9-91e1-ff5cae97cb87 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:29.143305 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a0e7f249-d128-44a9-91e1-ff5cae97cb87 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:29.144297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a0e7f249-d128-44a9-91e1-ff5cae97cb87 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:29.145605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a0e7f249-d128-44a9-91e1-ff5cae97cb87 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:29.245737 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7a36288e-30c1-4933-a250-334a3baf6a08 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:29.254420 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7a36288e-30c1-4933-a250-334a3baf6a08 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:29.256266 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7a36288e-30c1-4933-a250-334a3baf6a08 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:29.257724 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7a36288e-30c1-4933-a250-334a3baf6a08 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1740 microversion: 2.20 time: 0.227875 May 12 14:41:29.258493 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 574/1129] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:29 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:29.312719 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a0e7f249-d128-44a9-91e1-ff5cae97cb87 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:29.320128 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a0e7f249-d128-44a9-91e1-ff5cae97cb87 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1266 microversion: 2.1 time: 0.195113 May 12 14:41:29.320698 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 556/1130] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:29 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:41:30.125748 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-adbd5fbb-9ab3-4eac-a1c2-6a879fd5d910 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:30.126313 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-adbd5fbb-9ab3-4eac-a1c2-6a879fd5d910 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:30.132771 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-adbd5fbb-9ab3-4eac-a1c2-6a879fd5d910 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:30.133468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-adbd5fbb-9ab3-4eac-a1c2-6a879fd5d910 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:30.134259 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-adbd5fbb-9ab3-4eac-a1c2-6a879fd5d910 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:30.134709 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-adbd5fbb-9ab3-4eac-a1c2-6a879fd5d910 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:30.276923 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-368de851-b748-4ced-ad84-aa2b282c1fd6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:30.278199 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-368de851-b748-4ced-ad84-aa2b282c1fd6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:30.283987 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-adbd5fbb-9ab3-4eac-a1c2-6a879fd5d910 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:30.284717 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-368de851-b748-4ced-ad84-aa2b282c1fd6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:30.285174 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-368de851-b748-4ced-ad84-aa2b282c1fd6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:30.285960 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-368de851-b748-4ced-ad84-aa2b282c1fd6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:30.286402 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-368de851-b748-4ced-ad84-aa2b282c1fd6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:30.291271 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-adbd5fbb-9ab3-4eac-a1c2-6a879fd5d910 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1363 microversion: 2.1 time: 0.169402 May 12 14:41:30.291840 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 575/1131] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:30 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:30.337398 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-abd04b38-09d1-47bc-830c-1496e671a052 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:30.338018 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-abd04b38-09d1-47bc-830c-1496e671a052 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:30.346220 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-abd04b38-09d1-47bc-830c-1496e671a052 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:30.346705 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-abd04b38-09d1-47bc-830c-1496e671a052 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:30.348271 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-abd04b38-09d1-47bc-830c-1496e671a052 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:30.348734 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-abd04b38-09d1-47bc-830c-1496e671a052 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:30.457020 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-368de851-b748-4ced-ad84-aa2b282c1fd6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:30.473394 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-368de851-b748-4ced-ad84-aa2b282c1fd6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:30.475405 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-368de851-b748-4ced-ad84-aa2b282c1fd6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:30.477414 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-368de851-b748-4ced-ad84-aa2b282c1fd6 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1740 microversion: 2.20 time: 0.204065 May 12 14:41:30.478850 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 557/1132] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:30 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:41:30.510225 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-abd04b38-09d1-47bc-830c-1496e671a052 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:30.519383 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-abd04b38-09d1-47bc-830c-1496e671a052 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1266 microversion: 2.1 time: 0.185565 May 12 14:41:30.520373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 576/1133] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:30 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:41:31.309410 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-117b02ab-4491-4415-a82e-d00b48ba7870 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:31.310030 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-117b02ab-4491-4415-a82e-d00b48ba7870 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:31.318700 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-117b02ab-4491-4415-a82e-d00b48ba7870 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:31.319191 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-117b02ab-4491-4415-a82e-d00b48ba7870 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:31.319990 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-117b02ab-4491-4415-a82e-d00b48ba7870 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:31.320444 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-117b02ab-4491-4415-a82e-d00b48ba7870 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:31.487526 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-117b02ab-4491-4415-a82e-d00b48ba7870 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:31.495216 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-117b02ab-4491-4415-a82e-d00b48ba7870 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1363 microversion: 2.1 time: 0.191187 May 12 14:41:31.495795 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 558/1134] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:31 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:31.495966 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8b14ff67-e35f-4c75-be1c-1afe1373f82e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:31.497125 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8b14ff67-e35f-4c75-be1c-1afe1373f82e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:31.504026 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b14ff67-e35f-4c75-be1c-1afe1373f82e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:31.504487 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b14ff67-e35f-4c75-be1c-1afe1373f82e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:31.505491 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b14ff67-e35f-4c75-be1c-1afe1373f82e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:31.505940 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8b14ff67-e35f-4c75-be1c-1afe1373f82e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:31.536302 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3d9d7eb9-0250-4286-a368-49851901ede9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:31.537038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3d9d7eb9-0250-4286-a368-49851901ede9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:31.544162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3d9d7eb9-0250-4286-a368-49851901ede9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:31.544779 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3d9d7eb9-0250-4286-a368-49851901ede9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:31.545735 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3d9d7eb9-0250-4286-a368-49851901ede9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:31.546337 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3d9d7eb9-0250-4286-a368-49851901ede9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:31.759016 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8b14ff67-e35f-4c75-be1c-1afe1373f82e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:31.778774 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8b14ff67-e35f-4c75-be1c-1afe1373f82e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:31.780337 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8b14ff67-e35f-4c75-be1c-1afe1373f82e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:31.781789 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8b14ff67-e35f-4c75-be1c-1afe1373f82e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1740 microversion: 2.20 time: 0.290039 May 12 14:41:31.794033 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 577/1135] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:31 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:41:31.821791 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3d9d7eb9-0250-4286-a368-49851901ede9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:31.829698 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3d9d7eb9-0250-4286-a368-49851901ede9 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1454 microversion: 2.1 time: 0.297406 May 12 14:41:31.835370 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 559/1136] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:31 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1454 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:41:31.846961 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ee16323a-7d44-433a-936f-a178c2c138e6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:31.847751 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ee16323a-7d44-433a-936f-a178c2c138e6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:31.853999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ee16323a-7d44-433a-936f-a178c2c138e6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:31.854845 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ee16323a-7d44-433a-936f-a178c2c138e6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:31.856335 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ee16323a-7d44-433a-936f-a178c2c138e6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:31.856848 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ee16323a-7d44-433a-936f-a178c2c138e6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:31.995923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ee16323a-7d44-433a-936f-a178c2c138e6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:32.004510 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ee16323a-7d44-433a-936f-a178c2c138e6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1454 microversion: 2.1 time: 0.161909 May 12 14:41:32.005386 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 578/1137] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:31 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:32.514446 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0ed2fe64-1cd6-4864-a0f2-86f23eb84470 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:32.515884 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0ed2fe64-1cd6-4864-a0f2-86f23eb84470 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:32.526836 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0ed2fe64-1cd6-4864-a0f2-86f23eb84470 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:32.529012 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0ed2fe64-1cd6-4864-a0f2-86f23eb84470 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:32.530235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0ed2fe64-1cd6-4864-a0f2-86f23eb84470 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:32.531020 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0ed2fe64-1cd6-4864-a0f2-86f23eb84470 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:32.792546 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0ed2fe64-1cd6-4864-a0f2-86f23eb84470 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:32.800747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0ed2fe64-1cd6-4864-a0f2-86f23eb84470 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1363 microversion: 2.1 time: 0.291886 May 12 14:41:32.801047 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5af13dcf-2eaa-45cc-8530-76c4d72dde1a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:32.801677 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5af13dcf-2eaa-45cc-8530-76c4d72dde1a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:32.809611 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5af13dcf-2eaa-45cc-8530-76c4d72dde1a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:32.810064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5af13dcf-2eaa-45cc-8530-76c4d72dde1a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:32.811075 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5af13dcf-2eaa-45cc-8530-76c4d72dde1a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:32.811235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 560/1138] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:32 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:32.811701 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5af13dcf-2eaa-45cc-8530-76c4d72dde1a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:33.020061 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5af13dcf-2eaa-45cc-8530-76c4d72dde1a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:33.028930 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5af13dcf-2eaa-45cc-8530-76c4d72dde1a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:33.032199 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5af13dcf-2eaa-45cc-8530-76c4d72dde1a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:33.034341 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5af13dcf-2eaa-45cc-8530-76c4d72dde1a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1740 microversion: 2.20 time: 0.236278 May 12 14:41:33.035001 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 579/1139] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:32 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:33.336263 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-4e7fa760-c6b7-456e-883e-c626785d51e6 req-f8cec8b1-d4df-428e-9b96-741fefe5f0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b68e00-a067-4696-b0d5-2cc050569c72", "name": "network-vif-plugged", "status": "completed", "tag": "43202a5c-79c7-46ed-8988-a1031b1e8e9a"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:33.351397 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-4e7fa760-c6b7-456e-883e-c626785d51e6 req-f8cec8b1-d4df-428e-9b96-741fefe5f0d2 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:33.352335 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-4e7fa760-c6b7-456e-883e-c626785d51e6 req-f8cec8b1-d4df-428e-9b96-741fefe5f0d2 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:33.369872 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-4e7fa760-c6b7-456e-883e-c626785d51e6 req-f8cec8b1-d4df-428e-9b96-741fefe5f0d2 service nova] Creating event network-vif-plugged:43202a5c-79c7-46ed-8988-a1031b1e8e9a for instance b4b68e00-a067-4696-b0d5-2cc050569c72 on hv-cinder-77703 May 12 14:41:33.378696 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-4e7fa760-c6b7-456e-883e-c626785d51e6 req-f8cec8b1-d4df-428e-9b96-741fefe5f0d2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046979 May 12 14:41:33.380557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 561/1140] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:33.817802 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-500076ac-4107-40c9-a628-8793cf56c531 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:33.818405 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-500076ac-4107-40c9-a628-8793cf56c531 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:33.832317 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-500076ac-4107-40c9-a628-8793cf56c531 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:33.833155 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-500076ac-4107-40c9-a628-8793cf56c531 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:33.834686 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-500076ac-4107-40c9-a628-8793cf56c531 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:33.835377 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-500076ac-4107-40c9-a628-8793cf56c531 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:34.055502 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7ee08688-e6f6-4150-ab46-6c00192e7407 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:34.056896 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7ee08688-e6f6-4150-ab46-6c00192e7407 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:34.065504 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ee08688-e6f6-4150-ab46-6c00192e7407 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:34.066236 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ee08688-e6f6-4150-ab46-6c00192e7407 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:34.067241 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ee08688-e6f6-4150-ab46-6c00192e7407 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:34.067867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7ee08688-e6f6-4150-ab46-6c00192e7407 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:34.128080 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-500076ac-4107-40c9-a628-8793cf56c531 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:34.136000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-500076ac-4107-40c9-a628-8793cf56c531 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1363 microversion: 2.1 time: 0.322029 May 12 14:41:34.136811 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 580/1141] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:33 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:34.275118 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7ee08688-e6f6-4150-ab46-6c00192e7407 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:34.283821 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7ee08688-e6f6-4150-ab46-6c00192e7407 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:34.287020 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7ee08688-e6f6-4150-ab46-6c00192e7407 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:34.289279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7ee08688-e6f6-4150-ab46-6c00192e7407 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1740 microversion: 2.20 time: 0.239379 May 12 14:41:34.296906 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 562/1142] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:34 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:34.712343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-2e5cb941-12f4-4a1f-8d63-65914217246b req-62856236-b77f-4cba-9bc4-99d362563ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a93128f-bc24-4529-8b60-6d661e9933bf", "tag": "80f0b63a-177b-495c-b004-f7919b935f84"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:34.722456 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-2e5cb941-12f4-4a1f-8d63-65914217246b req-62856236-b77f-4cba-9bc4-99d362563ce5 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:34.723068 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-2e5cb941-12f4-4a1f-8d63-65914217246b req-62856236-b77f-4cba-9bc4-99d362563ce5 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:34.735806 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-2e5cb941-12f4-4a1f-8d63-65914217246b req-62856236-b77f-4cba-9bc4-99d362563ce5 service nova] Creating event network-changed:80f0b63a-177b-495c-b004-f7919b935f84 for instance 3a93128f-bc24-4529-8b60-6d661e9933bf on hv-cinder-77703 May 12 14:41:34.741219 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-2e5cb941-12f4-4a1f-8d63-65914217246b req-62856236-b77f-4cba-9bc4-99d362563ce5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032645 May 12 14:41:34.745158 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 581/1143] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:35.153306 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f16b2a6b-7b05-43f4-b05a-a7a221494647 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:35.153924 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f16b2a6b-7b05-43f4-b05a-a7a221494647 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:35.160833 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f16b2a6b-7b05-43f4-b05a-a7a221494647 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:35.161283 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f16b2a6b-7b05-43f4-b05a-a7a221494647 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:35.162067 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f16b2a6b-7b05-43f4-b05a-a7a221494647 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:35.162506 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f16b2a6b-7b05-43f4-b05a-a7a221494647 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:35.303950 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f16b2a6b-7b05-43f4-b05a-a7a221494647 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:35.311196 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ad2551f9-ec52-40cb-a6a7-8fd2768b7822 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:35.311928 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ad2551f9-ec52-40cb-a6a7-8fd2768b7822 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:35.312440 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f16b2a6b-7b05-43f4-b05a-a7a221494647 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1363 microversion: 2.1 time: 0.163433 May 12 14:41:35.319089 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 563/1144] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:35 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:35.323930 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ad2551f9-ec52-40cb-a6a7-8fd2768b7822 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:35.325124 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ad2551f9-ec52-40cb-a6a7-8fd2768b7822 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:35.326270 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ad2551f9-ec52-40cb-a6a7-8fd2768b7822 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:35.327987 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ad2551f9-ec52-40cb-a6a7-8fd2768b7822 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:35.489432 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ad2551f9-ec52-40cb-a6a7-8fd2768b7822 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:35.501338 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ad2551f9-ec52-40cb-a6a7-8fd2768b7822 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:35.502931 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ad2551f9-ec52-40cb-a6a7-8fd2768b7822 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:35.504198 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ad2551f9-ec52-40cb-a6a7-8fd2768b7822 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1740 microversion: 2.20 time: 0.199115 May 12 14:41:35.504832 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 582/1145] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:35 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:36.330534 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a9463a23-46b1-4d1e-8060-7aa4fd0161b1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:36.331233 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a9463a23-46b1-4d1e-8060-7aa4fd0161b1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:36.337727 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9463a23-46b1-4d1e-8060-7aa4fd0161b1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:36.338183 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9463a23-46b1-4d1e-8060-7aa4fd0161b1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:36.338974 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9463a23-46b1-4d1e-8060-7aa4fd0161b1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:36.339446 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a9463a23-46b1-4d1e-8060-7aa4fd0161b1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:36.482190 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a9463a23-46b1-4d1e-8060-7aa4fd0161b1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:36.490704 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a9463a23-46b1-4d1e-8060-7aa4fd0161b1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1548 microversion: 2.1 time: 0.163982 May 12 14:41:36.491400 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 564/1146] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:36 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:36.508724 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-600a8fb7-db82-4536-b850-9461be62cbbd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:36.509990 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-600a8fb7-db82-4536-b850-9461be62cbbd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:36.516834 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-600a8fb7-db82-4536-b850-9461be62cbbd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:36.517760 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-600a8fb7-db82-4536-b850-9461be62cbbd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:36.518647 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-600a8fb7-db82-4536-b850-9461be62cbbd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:36.519201 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-600a8fb7-db82-4536-b850-9461be62cbbd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:36.523769 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e23ba337-7b08-4425-a4a4-e83aa0538d9a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:36.524808 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e23ba337-7b08-4425-a4a4-e83aa0538d9a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:36.532123 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e23ba337-7b08-4425-a4a4-e83aa0538d9a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:36.532734 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e23ba337-7b08-4425-a4a4-e83aa0538d9a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:36.533532 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e23ba337-7b08-4425-a4a4-e83aa0538d9a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:36.534261 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e23ba337-7b08-4425-a4a4-e83aa0538d9a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:36.658189 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-600a8fb7-db82-4536-b850-9461be62cbbd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154128 May 12 14:41:36.659013 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 583/1147] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 12 14:41:36 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:36.737953 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e23ba337-7b08-4425-a4a4-e83aa0538d9a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:36.747597 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e23ba337-7b08-4425-a4a4-e83aa0538d9a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:36.754313 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e23ba337-7b08-4425-a4a4-e83aa0538d9a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:36.755882 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e23ba337-7b08-4425-a4a4-e83aa0538d9a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1740 microversion: 2.20 time: 0.236600 May 12 14:41:36.764296 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 565/1148] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:36 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:37.774149 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-592638f8-a213-4802-8018-c36fa14e0d4a req-b2def094-bdff-4aff-b9f1-49b3244bdb77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b68e00-a067-4696-b0d5-2cc050569c72", "tag": "43202a5c-79c7-46ed-8988-a1031b1e8e9a"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:37.782463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-153e6720-941f-4428-8625-56727e2a5898 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:37.783782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-153e6720-941f-4428-8625-56727e2a5898 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:37.800214 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-592638f8-a213-4802-8018-c36fa14e0d4a req-b2def094-bdff-4aff-b9f1-49b3244bdb77 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:37.800596 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-153e6720-941f-4428-8625-56727e2a5898 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:37.801314 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-153e6720-941f-4428-8625-56727e2a5898 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:37.802338 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-153e6720-941f-4428-8625-56727e2a5898 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:37.803010 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-592638f8-a213-4802-8018-c36fa14e0d4a req-b2def094-bdff-4aff-b9f1-49b3244bdb77 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:37.803717 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-153e6720-941f-4428-8625-56727e2a5898 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:37.861929 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-592638f8-a213-4802-8018-c36fa14e0d4a req-b2def094-bdff-4aff-b9f1-49b3244bdb77 service nova] Creating event network-changed:43202a5c-79c7-46ed-8988-a1031b1e8e9a for instance b4b68e00-a067-4696-b0d5-2cc050569c72 on hv-cinder-77703 May 12 14:41:37.873638 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-592638f8-a213-4802-8018-c36fa14e0d4a req-b2def094-bdff-4aff-b9f1-49b3244bdb77 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102928 May 12 14:41:37.874262 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 584/1149] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:41:38.031361 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-153e6720-941f-4428-8625-56727e2a5898 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:38.041140 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-153e6720-941f-4428-8625-56727e2a5898 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:38.043866 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-153e6720-941f-4428-8625-56727e2a5898 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:38.052340 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-153e6720-941f-4428-8625-56727e2a5898 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1740 microversion: 2.20 time: 0.273958 May 12 14:41:38.052937 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 566/1150] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:37 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1740 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:39.073161 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b2c823f4-afb2-4256-8869-77cf76bc80f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:39.075923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b2c823f4-afb2-4256-8869-77cf76bc80f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:39.089550 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b2c823f4-afb2-4256-8869-77cf76bc80f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:39.090902 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b2c823f4-afb2-4256-8869-77cf76bc80f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:39.091984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b2c823f4-afb2-4256-8869-77cf76bc80f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:39.092522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b2c823f4-afb2-4256-8869-77cf76bc80f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:39.235959 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b2c823f4-afb2-4256-8869-77cf76bc80f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:39.243962 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b2c823f4-afb2-4256-8869-77cf76bc80f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:39.245508 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b2c823f4-afb2-4256-8869-77cf76bc80f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:39.247375 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b2c823f4-afb2-4256-8869-77cf76bc80f1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1740 microversion: 2.20 time: 0.180728 May 12 14:41:39.247942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 585/1151] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:39 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:40.266491 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-de0c36bb-570f-4531-a854-fc5ced523595 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:40.267058 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-de0c36bb-570f-4531-a854-fc5ced523595 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:40.274470 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-de0c36bb-570f-4531-a854-fc5ced523595 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:40.275065 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-de0c36bb-570f-4531-a854-fc5ced523595 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:40.275951 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-de0c36bb-570f-4531-a854-fc5ced523595 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:40.276469 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-de0c36bb-570f-4531-a854-fc5ced523595 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:40.433176 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-de0c36bb-570f-4531-a854-fc5ced523595 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:40.441213 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-de0c36bb-570f-4531-a854-fc5ced523595 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:40.442752 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-de0c36bb-570f-4531-a854-fc5ced523595 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:40.443962 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-de0c36bb-570f-4531-a854-fc5ced523595 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1740 microversion: 2.20 time: 0.182456 May 12 14:41:40.454913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 567/1152] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:40 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:41.461741 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-52c2e733-752a-4fb5-9061-f6d2f3d3bda0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:41.462550 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-52c2e733-752a-4fb5-9061-f6d2f3d3bda0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:41.468937 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-52c2e733-752a-4fb5-9061-f6d2f3d3bda0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:41.469397 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-52c2e733-752a-4fb5-9061-f6d2f3d3bda0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:41.470216 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-52c2e733-752a-4fb5-9061-f6d2f3d3bda0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:41.470785 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-52c2e733-752a-4fb5-9061-f6d2f3d3bda0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:41.681884 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-52c2e733-752a-4fb5-9061-f6d2f3d3bda0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:41.689659 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-52c2e733-752a-4fb5-9061-f6d2f3d3bda0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:41.691209 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-52c2e733-752a-4fb5-9061-f6d2f3d3bda0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:41.692374 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-52c2e733-752a-4fb5-9061-f6d2f3d3bda0 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1740 microversion: 2.20 time: 0.234641 May 12 14:41:41.692942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 586/1153] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:41 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:42.034361 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9f817a7e-9457-4962-a778-445d23047ad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:42.034890 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9f817a7e-9457-4962-a778-445d23047ad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:42.041574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f817a7e-9457-4962-a778-445d23047ad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:42.042036 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f817a7e-9457-4962-a778-445d23047ad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:42.042520 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-bedf0f20-96da-4ecb-bd6c-597e755b514f req-3b36df23-350c-49bc-b599-57f21dd6a9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef", "tag": "228c90b8-3a08-410b-be25-ba639362a959"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:42.042872 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f817a7e-9457-4962-a778-445d23047ad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:42.043387 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f817a7e-9457-4962-a778-445d23047ad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:42.051312 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-bedf0f20-96da-4ecb-bd6c-597e755b514f req-3b36df23-350c-49bc-b599-57f21dd6a9c1 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:42.051767 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-bedf0f20-96da-4ecb-bd6c-597e755b514f req-3b36df23-350c-49bc-b599-57f21dd6a9c1 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:42.063281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-bedf0f20-96da-4ecb-bd6c-597e755b514f req-3b36df23-350c-49bc-b599-57f21dd6a9c1 service nova] Creating event network-changed:228c90b8-3a08-410b-be25-ba639362a959 for instance ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef on hv-cinder-77703 May 12 14:41:42.068172 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-bedf0f20-96da-4ecb-bd6c-597e755b514f req-3b36df23-350c-49bc-b599-57f21dd6a9c1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029132 May 12 14:41:42.069093 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 587/1154] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:42.069502 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9f817a7e-9457-4962-a778-445d23047ad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Going to try to terminate instance {{(pid=118216) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:41:42.146578 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9f817a7e-9457-4962-a778-445d23047ad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 204 len: 0 microversion: 2.1 time: 0.115657 May 12 14:41:42.147206 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 568/1155] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:41:42 2022] DELETE /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:41:42.156509 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-41195599-9099-4404-9867-620aa138d8a7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:42.157303 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-41195599-9099-4404-9867-620aa138d8a7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:42.163536 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-41195599-9099-4404-9867-620aa138d8a7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:42.164093 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-41195599-9099-4404-9867-620aa138d8a7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:42.165118 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-41195599-9099-4404-9867-620aa138d8a7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:42.165650 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-41195599-9099-4404-9867-620aa138d8a7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:42.303379 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-41195599-9099-4404-9867-620aa138d8a7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:42.310879 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-41195599-9099-4404-9867-620aa138d8a7 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.159201 May 12 14:41:42.311482 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 588/1156] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:42 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:42.710367 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d5b5c1a7-a0fd-4f74-9995-8ce2564074fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:42.711133 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d5b5c1a7-a0fd-4f74-9995-8ce2564074fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:42.716863 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d5b5c1a7-a0fd-4f74-9995-8ce2564074fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:42.717320 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d5b5c1a7-a0fd-4f74-9995-8ce2564074fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:42.718089 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d5b5c1a7-a0fd-4f74-9995-8ce2564074fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:42.718530 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d5b5c1a7-a0fd-4f74-9995-8ce2564074fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:42.864442 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d5b5c1a7-a0fd-4f74-9995-8ce2564074fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:42.873393 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d5b5c1a7-a0fd-4f74-9995-8ce2564074fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:42.874897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d5b5c1a7-a0fd-4f74-9995-8ce2564074fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:42.876120 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d5b5c1a7-a0fd-4f74-9995-8ce2564074fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1722 microversion: 2.20 time: 0.170105 May 12 14:41:42.876870 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 569/1157] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:42 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:41:43.329184 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7117f710-e520-4218-8cb4-c771d3e5cbaa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:43.329805 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7117f710-e520-4218-8cb4-c771d3e5cbaa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:43.336131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7117f710-e520-4218-8cb4-c771d3e5cbaa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:43.336673 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7117f710-e520-4218-8cb4-c771d3e5cbaa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:43.337440 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7117f710-e520-4218-8cb4-c771d3e5cbaa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:43.337876 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7117f710-e520-4218-8cb4-c771d3e5cbaa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:43.470801 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7117f710-e520-4218-8cb4-c771d3e5cbaa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:43.478219 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7117f710-e520-4218-8cb4-c771d3e5cbaa tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.152944 May 12 14:41:43.478792 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 589/1158] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:43 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:43.893993 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-056a349c-cc57-4a26-beba-a8e809de4d2a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:43.894634 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-056a349c-cc57-4a26-beba-a8e809de4d2a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:43.900991 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-056a349c-cc57-4a26-beba-a8e809de4d2a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:43.901439 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-056a349c-cc57-4a26-beba-a8e809de4d2a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:43.902717 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-056a349c-cc57-4a26-beba-a8e809de4d2a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:43.903186 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-056a349c-cc57-4a26-beba-a8e809de4d2a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:44.137829 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-056a349c-cc57-4a26-beba-a8e809de4d2a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:44.145738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-056a349c-cc57-4a26-beba-a8e809de4d2a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:44.147247 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-056a349c-cc57-4a26-beba-a8e809de4d2a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:44.148424 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-056a349c-cc57-4a26-beba-a8e809de4d2a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1722 microversion: 2.20 time: 0.258343 May 12 14:41:44.148997 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 570/1159] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:43 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:44.496967 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0ffd88dd-f79c-4871-ad3c-6da498bcbad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:44.497527 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0ffd88dd-f79c-4871-ad3c-6da498bcbad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:44.503861 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0ffd88dd-f79c-4871-ad3c-6da498bcbad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:44.504313 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0ffd88dd-f79c-4871-ad3c-6da498bcbad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:44.505084 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0ffd88dd-f79c-4871-ad3c-6da498bcbad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:44.505518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0ffd88dd-f79c-4871-ad3c-6da498bcbad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:44.746706 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0ffd88dd-f79c-4871-ad3c-6da498bcbad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:44.754577 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0ffd88dd-f79c-4871-ad3c-6da498bcbad2 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.262649 May 12 14:41:44.755238 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 590/1160] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:44 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:45.169112 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-208380eb-8e9e-4b7a-8b4f-21c8c4c63882 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:45.170076 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-208380eb-8e9e-4b7a-8b4f-21c8c4c63882 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:45.177182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-208380eb-8e9e-4b7a-8b4f-21c8c4c63882 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:45.178002 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-208380eb-8e9e-4b7a-8b4f-21c8c4c63882 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:45.179013 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-208380eb-8e9e-4b7a-8b4f-21c8c4c63882 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:45.179894 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-208380eb-8e9e-4b7a-8b4f-21c8c4c63882 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:45.238023 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-8807435b-5a9d-4295-a0b8-957df5fec104 req-77107c96-8506-4e7a-a9e3-a54298d11f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533a547e-b44f-4a33-8725-24b323556322", "name": "network-vif-unplugged", "status": "completed", "tag": "152a3c94-4ce4-4682-a2c1-1ad44f9d899e"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:45.248786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-8807435b-5a9d-4295-a0b8-957df5fec104 req-77107c96-8506-4e7a-a9e3-a54298d11f81 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:45.249233 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-8807435b-5a9d-4295-a0b8-957df5fec104 req-77107c96-8506-4e7a-a9e3-a54298d11f81 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:45.263069 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-8807435b-5a9d-4295-a0b8-957df5fec104 req-77107c96-8506-4e7a-a9e3-a54298d11f81 service nova] Creating event network-vif-unplugged:152a3c94-4ce4-4682-a2c1-1ad44f9d899e for instance 533a547e-b44f-4a33-8725-24b323556322 on hv-cinder-77703 May 12 14:41:45.268012 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-8807435b-5a9d-4295-a0b8-957df5fec104 req-77107c96-8506-4e7a-a9e3-a54298d11f81 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033548 May 12 14:41:45.269418 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 591/1161] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:41:45.772994 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-34d7c751-e09f-43fe-901c-e4db070404d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:45.773870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-34d7c751-e09f-43fe-901c-e4db070404d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:45.780869 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-34d7c751-e09f-43fe-901c-e4db070404d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:45.781422 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-34d7c751-e09f-43fe-901c-e4db070404d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:45.782272 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-34d7c751-e09f-43fe-901c-e4db070404d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:45.782931 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-34d7c751-e09f-43fe-901c-e4db070404d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:45.845156 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-208380eb-8e9e-4b7a-8b4f-21c8c4c63882 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:45.854223 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-208380eb-8e9e-4b7a-8b4f-21c8c4c63882 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:45.856397 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-208380eb-8e9e-4b7a-8b4f-21c8c4c63882 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:45.857586 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-208380eb-8e9e-4b7a-8b4f-21c8c4c63882 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1722 microversion: 2.20 time: 0.693182 May 12 14:41:45.858159 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 571/1162] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:45 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1722 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:46.065820 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-34d7c751-e09f-43fe-901c-e4db070404d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:46.074897 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-34d7c751-e09f-43fe-901c-e4db070404d5 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1568 microversion: 2.1 time: 0.306243 May 12 14:41:46.075516 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 592/1163] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:45 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1568 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:41:46.288772 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-4b9482a2-c39b-4df4-8e97-5911beb510fc req-2e9f9e83-cff5-420f-bca5-92f8eb63d1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef", "name": "network-vif-deleted", "tag": "228c90b8-3a08-410b-be25-ba639362a959"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:46.297846 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-4b9482a2-c39b-4df4-8e97-5911beb510fc req-2e9f9e83-cff5-420f-bca5-92f8eb63d1c1 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:46.298232 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-4b9482a2-c39b-4df4-8e97-5911beb510fc req-2e9f9e83-cff5-420f-bca5-92f8eb63d1c1 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:46.308869 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-4b9482a2-c39b-4df4-8e97-5911beb510fc req-2e9f9e83-cff5-420f-bca5-92f8eb63d1c1 service nova] Creating event network-vif-deleted:228c90b8-3a08-410b-be25-ba639362a959 for instance ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef on hv-cinder-77703 May 12 14:41:46.313618 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-4b9482a2-c39b-4df4-8e97-5911beb510fc req-2e9f9e83-cff5-420f-bca5-92f8eb63d1c1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028549 May 12 14:41:46.314198 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 572/1164] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:46.876259 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ae74b438-0d32-454b-93c2-f10bf1eb51f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:46.876913 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ae74b438-0d32-454b-93c2-f10bf1eb51f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:46.882887 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ae74b438-0d32-454b-93c2-f10bf1eb51f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:46.883390 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ae74b438-0d32-454b-93c2-f10bf1eb51f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:46.884168 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ae74b438-0d32-454b-93c2-f10bf1eb51f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:46.884614 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ae74b438-0d32-454b-93c2-f10bf1eb51f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:47.015057 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ae74b438-0d32-454b-93c2-f10bf1eb51f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:47.022816 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ae74b438-0d32-454b-93c2-f10bf1eb51f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:47.024396 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ae74b438-0d32-454b-93c2-f10bf1eb51f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:47.025575 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ae74b438-0d32-454b-93c2-f10bf1eb51f5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1722 microversion: 2.20 time: 0.153421 May 12 14:41:47.026153 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 593/1165] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:46 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:47.093782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7bf6d0fd-4793-43d0-84cf-aee3952df754 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:47.094512 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7bf6d0fd-4793-43d0-84cf-aee3952df754 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:47.100680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7bf6d0fd-4793-43d0-84cf-aee3952df754 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:47.101131 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7bf6d0fd-4793-43d0-84cf-aee3952df754 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:47.101895 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7bf6d0fd-4793-43d0-84cf-aee3952df754 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:47.102329 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7bf6d0fd-4793-43d0-84cf-aee3952df754 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:47.162738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7bf6d0fd-4793-43d0-84cf-aee3952df754 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:47.170257 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7bf6d0fd-4793-43d0-84cf-aee3952df754 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1382 microversion: 2.1 time: 0.080684 May 12 14:41:47.170797 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 573/1166] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:47 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1382 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:48.044703 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-44d8eca2-9d61-4483-8d27-edf3d378ccfc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:48.045449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-44d8eca2-9d61-4483-8d27-edf3d378ccfc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:48.053407 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-44d8eca2-9d61-4483-8d27-edf3d378ccfc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:48.053873 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-44d8eca2-9d61-4483-8d27-edf3d378ccfc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:48.055075 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-44d8eca2-9d61-4483-8d27-edf3d378ccfc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:48.055530 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-44d8eca2-9d61-4483-8d27-edf3d378ccfc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:48.183924 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-44d8eca2-9d61-4483-8d27-edf3d378ccfc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:48.186940 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ff03cf16-df7e-43c9-bb6f-f201a52cbd79 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:48.187584 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ff03cf16-df7e-43c9-bb6f-f201a52cbd79 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:48.191628 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-44d8eca2-9d61-4483-8d27-edf3d378ccfc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:48.193131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-44d8eca2-9d61-4483-8d27-edf3d378ccfc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:48.193814 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff03cf16-df7e-43c9-bb6f-f201a52cbd79 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:48.194270 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff03cf16-df7e-43c9-bb6f-f201a52cbd79 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:48.194391 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-44d8eca2-9d61-4483-8d27-edf3d378ccfc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1725 microversion: 2.20 time: 0.154457 May 12 14:41:48.194834 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 594/1167] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:48 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:48.195064 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff03cf16-df7e-43c9-bb6f-f201a52cbd79 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:48.195511 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff03cf16-df7e-43c9-bb6f-f201a52cbd79 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:48.212260 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c53d5d4a-feac-44d2-b2f9-e10061e0f16d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1ce8527-06c0-42bf-9138-eb001a884655"}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:48.213258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c53d5d4a-feac-44d2-b2f9-e10061e0f16d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:48.219651 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c53d5d4a-feac-44d2-b2f9-e10061e0f16d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:48.220106 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c53d5d4a-feac-44d2-b2f9-e10061e0f16d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:48.220872 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c53d5d4a-feac-44d2-b2f9-e10061e0f16d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:48.221307 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c53d5d4a-feac-44d2-b2f9-e10061e0f16d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:48.261026 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ff03cf16-df7e-43c9-bb6f-f201a52cbd79 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a65b858f4644a619a9c34cb99251efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bb0671fa894da79848c7c46e553b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:48.268966 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ff03cf16-df7e-43c9-bb6f-f201a52cbd79 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 200 len: 1218 microversion: 2.1 time: 0.085825 May 12 14:41:48.269547 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 574/1168] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:48 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:41:48.482289 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c53d5d4a-feac-44d2-b2f9-e10061e0f16d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "POST /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.274015 May 12 14:41:48.482896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 595/1169] 10.222.0.75 () {62 vars in 1363 bytes} [Thu May 12 14:41:48 2022] POST /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322/os-volume_attachments => generated 188 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:41:48.594809 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-48c53e1e-a1ba-4780-b145-c415df3bbfbf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:48.595329 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-48c53e1e-a1ba-4780-b145-c415df3bbfbf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:48.601158 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48c53e1e-a1ba-4780-b145-c415df3bbfbf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:48.601603 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48c53e1e-a1ba-4780-b145-c415df3bbfbf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:48.602446 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48c53e1e-a1ba-4780-b145-c415df3bbfbf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:48.602878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-48c53e1e-a1ba-4780-b145-c415df3bbfbf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:48.874610 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-48c53e1e-a1ba-4780-b145-c415df3bbfbf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "DELETE /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322/os-volume_attachments/c1ce8527-06c0-42bf-9138-eb001a884655" status: 202 len: 0 microversion: 2.20 time: 0.283727 May 12 14:41:48.875306 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 575/1170] 10.222.0.75 () {60 vars in 1456 bytes} [Thu May 12 14:41:48 2022] DELETE /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322/os-volume_attachments/c1ce8527-06c0-42bf-9138-eb001a884655 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:41:48.928737 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-76c36c71-3f90-42f0-8cc3-7df278f6a4bc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:48.929306 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-76c36c71-3f90-42f0-8cc3-7df278f6a4bc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:48.935738 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76c36c71-3f90-42f0-8cc3-7df278f6a4bc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:48.936193 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76c36c71-3f90-42f0-8cc3-7df278f6a4bc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:48.936968 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76c36c71-3f90-42f0-8cc3-7df278f6a4bc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:48.937408 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-76c36c71-3f90-42f0-8cc3-7df278f6a4bc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:49.025902 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-76c36c71-3f90-42f0-8cc3-7df278f6a4bc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "POST /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322/action" status: 202 len: 0 microversion: 2.20 time: 0.100947 May 12 14:41:49.026439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 596/1171] 10.222.0.75 () {62 vars in 1318 bytes} [Thu May 12 14:41:48 2022] POST /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:41:49.034615 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b9c92470-2224-4a61-8776-c2f82269f7b9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:49.035286 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b9c92470-2224-4a61-8776-c2f82269f7b9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:49.041530 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b9c92470-2224-4a61-8776-c2f82269f7b9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:49.041990 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b9c92470-2224-4a61-8776-c2f82269f7b9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:49.042778 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b9c92470-2224-4a61-8776-c2f82269f7b9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:49.043768 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b9c92470-2224-4a61-8776-c2f82269f7b9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:49.180072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b9c92470-2224-4a61-8776-c2f82269f7b9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:49.188874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b9c92470-2224-4a61-8776-c2f82269f7b9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:49.190480 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b9c92470-2224-4a61-8776-c2f82269f7b9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:49.192002 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b9c92470-2224-4a61-8776-c2f82269f7b9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1673 microversion: 2.20 time: 0.161295 May 12 14:41:49.192706 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 576/1172] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:49 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:49.287898 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b9eb8ded-855f-4cf1-bdfd-aa9a48a0801a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:49.288649 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b9eb8ded-855f-4cf1-bdfd-aa9a48a0801a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] [instance: ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:49.308418 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9eb8ded-855f-4cf1-bdfd-aa9a48a0801a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:49.309137 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9eb8ded-855f-4cf1-bdfd-aa9a48a0801a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:49.310235 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9eb8ded-855f-4cf1-bdfd-aa9a48a0801a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:49.310751 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9eb8ded-855f-4cf1-bdfd-aa9a48a0801a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:49.331129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-b9eb8ded-855f-4cf1-bdfd-aa9a48a0801a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] HTTP exception thrown: Instance ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef could not be found. May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b9eb8ded-855f-4cf1-bdfd-aa9a48a0801a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Request method failure captured: May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef HTTP/1.1 May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRrx7w02-zuNRlDgSsa5aryhVzZAAtgW_uYyu7p2F7uwJub-ZQLtHjr--NNECPTkj7AtqUKS0wWznP49r423U6ZxwOSCdzrZIbzKR-1lmQL2Gy9aQlnufTIEy5gAE80sjvKiPdxrMlfNCr-AJ0QYrOMmlfdgo87XI4e-ikvsv641Do4 May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: d9bb0671fa894da79848c7c46e553b5e May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-TestShelveInstance-916349541 May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:41:49.332129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:41:49.333763 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d9bb0671fa894da79848c7c46e553b5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d9bb0671fa894da79848c7c46e553b5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d9bb0671fa894da79848c7c46e553b5e", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d9bb0671fa894da79848c7c46e553b5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:41:49.333763 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-TestShelveInstance-916349541 May 12 14:41:49.333763 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: d9bb0671fa894da79848c7c46e553b5e May 12 14:41:49.333763 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-TestShelveInstance-916349541 May 12 14:41:49.333763 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-TestShelveInstance-916349541-project May 12 14:41:49.333763 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:41:49.333763 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:41:49.333763 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: 4a65b858f4644a619a9c34cb99251efb May 12 14:41:49.333763 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-TestShelveInstance-916349541-project May 12 14:41:49.333763 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:41:49.333763 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef could not be found. May 12 14:41:49.333763 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': 'ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef'} May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef could not be found. May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:41:49.334726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef could not be found. May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef could not be found. May 12 14:41:49.336281 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:41:49.337685 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b9eb8ded-855f-4cf1-bdfd-aa9a48a0801a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Returning 404 to user: Instance ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:41:49.337685 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b9eb8ded-855f-4cf1-bdfd-aa9a48a0801a tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef" status: 404 len: 111 microversion: 2.1 time: 0.051696 May 12 14:41:49.343052 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 597/1173] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:41:49 2022] GET /compute/v2.1/servers/ec64ac8c-7a8d-41d5-a85a-1b67d7fbd5ef => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:41:49.541962 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-65caf01f-fd62-4eb8-9ad3-b8cdc030d746 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] Calling method '.version_select at 0x7f5b26214ee0>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:49.563654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-65caf01f-fd62-4eb8-9ad3-b8cdc030d746 tempest-TestShelveInstance-916349541 tempest-TestShelveInstance-916349541-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-273927603" status: 202 len: 0 microversion: 2.1 time: 0.027066 May 12 14:41:49.565292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 577/1174] 10.222.0.75 () {58 vars in 1250 bytes} [Thu May 12 14:41:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-273927603 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:41:50.211056 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-01a70407-abd1-4aff-ba3e-853b7fa24df1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:50.211691 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-01a70407-abd1-4aff-ba3e-853b7fa24df1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:50.217657 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-01a70407-abd1-4aff-ba3e-853b7fa24df1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:50.218169 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-01a70407-abd1-4aff-ba3e-853b7fa24df1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:50.218940 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-01a70407-abd1-4aff-ba3e-853b7fa24df1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:50.219454 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-01a70407-abd1-4aff-ba3e-853b7fa24df1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:50.462656 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-01a70407-abd1-4aff-ba3e-853b7fa24df1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:50.471475 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-01a70407-abd1-4aff-ba3e-853b7fa24df1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:50.472987 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-01a70407-abd1-4aff-ba3e-853b7fa24df1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:50.474167 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-01a70407-abd1-4aff-ba3e-853b7fa24df1 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.267033 May 12 14:41:50.474727 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 598/1175] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:50 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:51.495366 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e3aefda9-87d0-4996-9b96-1b3f5c17cfa7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:51.495910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e3aefda9-87d0-4996-9b96-1b3f5c17cfa7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:51.502921 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e3aefda9-87d0-4996-9b96-1b3f5c17cfa7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:51.503427 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e3aefda9-87d0-4996-9b96-1b3f5c17cfa7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:51.504220 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e3aefda9-87d0-4996-9b96-1b3f5c17cfa7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:51.504665 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e3aefda9-87d0-4996-9b96-1b3f5c17cfa7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:51.733782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e3aefda9-87d0-4996-9b96-1b3f5c17cfa7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:51.741775 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e3aefda9-87d0-4996-9b96-1b3f5c17cfa7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:51.743351 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e3aefda9-87d0-4996-9b96-1b3f5c17cfa7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:51.744786 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e3aefda9-87d0-4996-9b96-1b3f5c17cfa7 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.254374 May 12 14:41:51.745355 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 578/1176] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:51 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:52.764576 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8d6eda16-8ea4-4b01-9413-141e0a37704c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:52.765109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8d6eda16-8ea4-4b01-9413-141e0a37704c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:52.771846 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d6eda16-8ea4-4b01-9413-141e0a37704c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:52.772398 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d6eda16-8ea4-4b01-9413-141e0a37704c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:52.773265 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d6eda16-8ea4-4b01-9413-141e0a37704c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:52.773787 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d6eda16-8ea4-4b01-9413-141e0a37704c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:53.030365 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8d6eda16-8ea4-4b01-9413-141e0a37704c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:53.039298 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8d6eda16-8ea4-4b01-9413-141e0a37704c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:53.041658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8d6eda16-8ea4-4b01-9413-141e0a37704c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:53.043847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8d6eda16-8ea4-4b01-9413-141e0a37704c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.283785 May 12 14:41:53.049655 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 599/1177] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:52 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:54.062030 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7607e2c1-2cae-4475-8f70-163c9006a92c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:54.062749 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7607e2c1-2cae-4475-8f70-163c9006a92c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:54.069614 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7607e2c1-2cae-4475-8f70-163c9006a92c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:54.070075 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7607e2c1-2cae-4475-8f70-163c9006a92c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:54.070880 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7607e2c1-2cae-4475-8f70-163c9006a92c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:54.071370 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7607e2c1-2cae-4475-8f70-163c9006a92c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:54.212950 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7607e2c1-2cae-4475-8f70-163c9006a92c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:54.221935 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7607e2c1-2cae-4475-8f70-163c9006a92c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:54.223819 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7607e2c1-2cae-4475-8f70-163c9006a92c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:54.225034 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7607e2c1-2cae-4475-8f70-163c9006a92c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.167014 May 12 14:41:54.225611 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 579/1178] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:54 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:55.245343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9c86debc-9e48-4ca8-aff4-888e5c888a8e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:55.245959 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9c86debc-9e48-4ca8-aff4-888e5c888a8e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:55.253490 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9c86debc-9e48-4ca8-aff4-888e5c888a8e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:55.254129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9c86debc-9e48-4ca8-aff4-888e5c888a8e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:55.255631 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9c86debc-9e48-4ca8-aff4-888e5c888a8e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:55.256232 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9c86debc-9e48-4ca8-aff4-888e5c888a8e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:55.427474 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9c86debc-9e48-4ca8-aff4-888e5c888a8e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:55.435918 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9c86debc-9e48-4ca8-aff4-888e5c888a8e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:55.438096 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9c86debc-9e48-4ca8-aff4-888e5c888a8e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:55.439401 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9c86debc-9e48-4ca8-aff4-888e5c888a8e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.199046 May 12 14:41:55.439975 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 600/1179] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:55 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:56.459762 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a04d9d38-c61d-4936-964b-65e6fb9adc54 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:56.461683 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a04d9d38-c61d-4936-964b-65e6fb9adc54 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:56.469216 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a04d9d38-c61d-4936-964b-65e6fb9adc54 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:56.469962 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a04d9d38-c61d-4936-964b-65e6fb9adc54 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:56.470992 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a04d9d38-c61d-4936-964b-65e6fb9adc54 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:56.471549 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a04d9d38-c61d-4936-964b-65e6fb9adc54 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:56.943650 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a04d9d38-c61d-4936-964b-65e6fb9adc54 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:56.953451 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a04d9d38-c61d-4936-964b-65e6fb9adc54 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:56.955176 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a04d9d38-c61d-4936-964b-65e6fb9adc54 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:56.956371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a04d9d38-c61d-4936-964b-65e6fb9adc54 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.502440 May 12 14:41:56.956944 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 580/1180] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:56 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:57.974129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-81122820-1b16-4860-8c16-64c144d57a19 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:57.974991 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-81122820-1b16-4860-8c16-64c144d57a19 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:57.991935 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-81122820-1b16-4860-8c16-64c144d57a19 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:57.992618 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-81122820-1b16-4860-8c16-64c144d57a19 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:57.994215 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-81122820-1b16-4860-8c16-64c144d57a19 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:57.994677 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-81122820-1b16-4860-8c16-64c144d57a19 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:58.136690 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-81122820-1b16-4860-8c16-64c144d57a19 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:58.145882 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-81122820-1b16-4860-8c16-64c144d57a19 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:58.147522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-81122820-1b16-4860-8c16-64c144d57a19 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:58.148813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-81122820-1b16-4860-8c16-64c144d57a19 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.178732 May 12 14:41:58.149368 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 601/1181] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:57 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:59.167093 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-022e3e19-e463-4569-8fb4-8998ccb9ba56 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:59.167813 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-022e3e19-e463-4569-8fb4-8998ccb9ba56 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:41:59.174032 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-022e3e19-e463-4569-8fb4-8998ccb9ba56 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:59.174486 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-022e3e19-e463-4569-8fb4-8998ccb9ba56 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:59.175427 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-022e3e19-e463-4569-8fb4-8998ccb9ba56 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:41:59.175749 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-022e3e19-e463-4569-8fb4-8998ccb9ba56 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:41:59.311520 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-022e3e19-e463-4569-8fb4-8998ccb9ba56 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:59.319246 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-022e3e19-e463-4569-8fb4-8998ccb9ba56 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:59.320884 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-022e3e19-e463-4569-8fb4-8998ccb9ba56 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:41:59.322032 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-022e3e19-e463-4569-8fb4-8998ccb9ba56 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.158965 May 12 14:41:59.322603 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 581/1182] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:41:59 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:00.340912 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bbcb3b6f-0e8b-4d25-9a9e-5f7b0d97ca13 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:00.341664 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bbcb3b6f-0e8b-4d25-9a9e-5f7b0d97ca13 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:00.357540 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bbcb3b6f-0e8b-4d25-9a9e-5f7b0d97ca13 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:00.357995 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bbcb3b6f-0e8b-4d25-9a9e-5f7b0d97ca13 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:00.358781 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bbcb3b6f-0e8b-4d25-9a9e-5f7b0d97ca13 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:00.359252 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bbcb3b6f-0e8b-4d25-9a9e-5f7b0d97ca13 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:00.497660 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bbcb3b6f-0e8b-4d25-9a9e-5f7b0d97ca13 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:00.505355 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bbcb3b6f-0e8b-4d25-9a9e-5f7b0d97ca13 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:00.506870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bbcb3b6f-0e8b-4d25-9a9e-5f7b0d97ca13 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:00.508073 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bbcb3b6f-0e8b-4d25-9a9e-5f7b0d97ca13 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.171753 May 12 14:42:00.508646 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 602/1183] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:00 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:01.526925 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-be9d66eb-e079-4a8e-838c-f476bd28b2fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:01.528207 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-be9d66eb-e079-4a8e-838c-f476bd28b2fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:01.534475 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-be9d66eb-e079-4a8e-838c-f476bd28b2fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:01.534929 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-be9d66eb-e079-4a8e-838c-f476bd28b2fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:01.535886 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-be9d66eb-e079-4a8e-838c-f476bd28b2fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:01.536393 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-be9d66eb-e079-4a8e-838c-f476bd28b2fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:01.689146 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-be9d66eb-e079-4a8e-838c-f476bd28b2fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:01.696987 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-be9d66eb-e079-4a8e-838c-f476bd28b2fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:01.698493 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-be9d66eb-e079-4a8e-838c-f476bd28b2fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:01.699727 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-be9d66eb-e079-4a8e-838c-f476bd28b2fc tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.176900 May 12 14:42:01.700291 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 582/1184] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:01 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:02.718193 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9fdf0532-46b8-42aa-8e4f-f90f60933686 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:02.718833 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9fdf0532-46b8-42aa-8e4f-f90f60933686 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:02.725122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9fdf0532-46b8-42aa-8e4f-f90f60933686 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:02.725582 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9fdf0532-46b8-42aa-8e4f-f90f60933686 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:02.726355 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9fdf0532-46b8-42aa-8e4f-f90f60933686 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:02.726800 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9fdf0532-46b8-42aa-8e4f-f90f60933686 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:02.862403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9fdf0532-46b8-42aa-8e4f-f90f60933686 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:02.870812 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9fdf0532-46b8-42aa-8e4f-f90f60933686 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:02.872397 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-9fdf0532-46b8-42aa-8e4f-f90f60933686 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:02.874267 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9fdf0532-46b8-42aa-8e4f-f90f60933686 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.159832 May 12 14:42:02.874831 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 603/1185] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:02 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:03.892783 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a31fae49-0fad-40b0-91e0-e760bf776663 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:03.893407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a31fae49-0fad-40b0-91e0-e760bf776663 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:03.899526 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a31fae49-0fad-40b0-91e0-e760bf776663 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:03.899977 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a31fae49-0fad-40b0-91e0-e760bf776663 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:03.900748 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a31fae49-0fad-40b0-91e0-e760bf776663 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:03.901189 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a31fae49-0fad-40b0-91e0-e760bf776663 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:04.038568 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a31fae49-0fad-40b0-91e0-e760bf776663 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:04.047544 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a31fae49-0fad-40b0-91e0-e760bf776663 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:04.049494 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a31fae49-0fad-40b0-91e0-e760bf776663 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:04.050663 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a31fae49-0fad-40b0-91e0-e760bf776663 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.161833 May 12 14:42:04.051265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 583/1186] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:03 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:05.068632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f9601108-3bee-47fd-8936-1cb441d5f559 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:05.069249 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f9601108-3bee-47fd-8936-1cb441d5f559 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:05.076091 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f9601108-3bee-47fd-8936-1cb441d5f559 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:05.076557 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f9601108-3bee-47fd-8936-1cb441d5f559 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:05.077342 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f9601108-3bee-47fd-8936-1cb441d5f559 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:05.077793 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f9601108-3bee-47fd-8936-1cb441d5f559 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:05.212460 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f9601108-3bee-47fd-8936-1cb441d5f559 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:05.221021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f9601108-3bee-47fd-8936-1cb441d5f559 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:05.222479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f9601108-3bee-47fd-8936-1cb441d5f559 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:05.223681 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f9601108-3bee-47fd-8936-1cb441d5f559 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.159006 May 12 14:42:05.224240 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 604/1187] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:05 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:06.241833 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6e04d922-f9f2-461a-9b64-808064817550 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:06.242400 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6e04d922-f9f2-461a-9b64-808064817550 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:06.249678 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6e04d922-f9f2-461a-9b64-808064817550 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:06.250125 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6e04d922-f9f2-461a-9b64-808064817550 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:06.250889 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6e04d922-f9f2-461a-9b64-808064817550 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:06.251356 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6e04d922-f9f2-461a-9b64-808064817550 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:06.383503 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6e04d922-f9f2-461a-9b64-808064817550 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:06.391557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6e04d922-f9f2-461a-9b64-808064817550 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:06.393072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6e04d922-f9f2-461a-9b64-808064817550 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:06.394440 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6e04d922-f9f2-461a-9b64-808064817550 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.156548 May 12 14:42:06.395013 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 584/1188] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:06 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:07.413675 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3357bcd0-cba5-4512-897e-5656c04d2ede tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:07.414356 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3357bcd0-cba5-4512-897e-5656c04d2ede tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:07.421277 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3357bcd0-cba5-4512-897e-5656c04d2ede tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:07.421724 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3357bcd0-cba5-4512-897e-5656c04d2ede tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:07.422490 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3357bcd0-cba5-4512-897e-5656c04d2ede tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:07.422925 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3357bcd0-cba5-4512-897e-5656c04d2ede tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:07.554231 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3357bcd0-cba5-4512-897e-5656c04d2ede tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:07.561847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3357bcd0-cba5-4512-897e-5656c04d2ede tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:07.563375 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3357bcd0-cba5-4512-897e-5656c04d2ede tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:07.564530 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3357bcd0-cba5-4512-897e-5656c04d2ede tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.154810 May 12 14:42:07.565090 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 605/1189] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:07 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:08.583723 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6b7bd53b-989a-4dfd-8870-67157a03cfd9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:08.584327 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6b7bd53b-989a-4dfd-8870-67157a03cfd9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:08.590928 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6b7bd53b-989a-4dfd-8870-67157a03cfd9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:08.591480 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6b7bd53b-989a-4dfd-8870-67157a03cfd9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:08.592254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6b7bd53b-989a-4dfd-8870-67157a03cfd9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:08.592700 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6b7bd53b-989a-4dfd-8870-67157a03cfd9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:08.721673 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6b7bd53b-989a-4dfd-8870-67157a03cfd9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:08.729513 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6b7bd53b-989a-4dfd-8870-67157a03cfd9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:08.731078 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6b7bd53b-989a-4dfd-8870-67157a03cfd9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:08.732250 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6b7bd53b-989a-4dfd-8870-67157a03cfd9 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.153138 May 12 14:42:08.732819 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 585/1190] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:08 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:09.750759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7b81dd02-eab0-4935-b06d-8d8ee6788f3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:09.751427 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7b81dd02-eab0-4935-b06d-8d8ee6788f3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:09.757799 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7b81dd02-eab0-4935-b06d-8d8ee6788f3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:09.758257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7b81dd02-eab0-4935-b06d-8d8ee6788f3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:09.759048 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7b81dd02-eab0-4935-b06d-8d8ee6788f3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:09.759506 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7b81dd02-eab0-4935-b06d-8d8ee6788f3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:09.886935 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7b81dd02-eab0-4935-b06d-8d8ee6788f3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:09.894660 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7b81dd02-eab0-4935-b06d-8d8ee6788f3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:09.896223 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7b81dd02-eab0-4935-b06d-8d8ee6788f3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:09.897392 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7b81dd02-eab0-4935-b06d-8d8ee6788f3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.151254 May 12 14:42:09.897960 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 606/1191] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:09 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:10.915640 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-396225ca-dd9f-45c5-b2de-c215f956802b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:10.916257 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-396225ca-dd9f-45c5-b2de-c215f956802b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:10.923126 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-396225ca-dd9f-45c5-b2de-c215f956802b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:10.923578 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-396225ca-dd9f-45c5-b2de-c215f956802b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:10.924342 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-396225ca-dd9f-45c5-b2de-c215f956802b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:10.924786 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-396225ca-dd9f-45c5-b2de-c215f956802b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:11.051152 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-396225ca-dd9f-45c5-b2de-c215f956802b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:11.059232 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-396225ca-dd9f-45c5-b2de-c215f956802b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:11.061333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-396225ca-dd9f-45c5-b2de-c215f956802b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:11.062489 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-396225ca-dd9f-45c5-b2de-c215f956802b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.151170 May 12 14:42:11.063065 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 586/1192] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:10 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:12.081212 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d573e61b-262c-4f78-89ad-5cc7eac4e743 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:12.081827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d573e61b-262c-4f78-89ad-5cc7eac4e743 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:12.088220 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d573e61b-262c-4f78-89ad-5cc7eac4e743 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:12.088672 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d573e61b-262c-4f78-89ad-5cc7eac4e743 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:12.089439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d573e61b-262c-4f78-89ad-5cc7eac4e743 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:12.090491 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d573e61b-262c-4f78-89ad-5cc7eac4e743 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:12.213104 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d573e61b-262c-4f78-89ad-5cc7eac4e743 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:12.221376 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d573e61b-262c-4f78-89ad-5cc7eac4e743 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:12.222826 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d573e61b-262c-4f78-89ad-5cc7eac4e743 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:12.224012 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d573e61b-262c-4f78-89ad-5cc7eac4e743 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.146718 May 12 14:42:12.224570 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 607/1193] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:12 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:13.241929 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c3ca4e90-144b-4500-974c-62f4cbb6b23a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:13.242480 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c3ca4e90-144b-4500-974c-62f4cbb6b23a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:13.249622 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c3ca4e90-144b-4500-974c-62f4cbb6b23a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:13.250069 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c3ca4e90-144b-4500-974c-62f4cbb6b23a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:13.250833 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c3ca4e90-144b-4500-974c-62f4cbb6b23a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:13.251303 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c3ca4e90-144b-4500-974c-62f4cbb6b23a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:13.382048 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c3ca4e90-144b-4500-974c-62f4cbb6b23a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:13.390286 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c3ca4e90-144b-4500-974c-62f4cbb6b23a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:13.391822 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c3ca4e90-144b-4500-974c-62f4cbb6b23a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:13.392972 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c3ca4e90-144b-4500-974c-62f4cbb6b23a tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.155056 May 12 14:42:13.393565 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 587/1194] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:13 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:14.410883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1d1b78b2-94c3-423c-baf7-1bf1cc027da5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:14.411526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1d1b78b2-94c3-423c-baf7-1bf1cc027da5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:14.417777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d1b78b2-94c3-423c-baf7-1bf1cc027da5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:14.418777 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d1b78b2-94c3-423c-baf7-1bf1cc027da5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:14.419569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d1b78b2-94c3-423c-baf7-1bf1cc027da5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:14.420007 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1d1b78b2-94c3-423c-baf7-1bf1cc027da5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:14.550903 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1d1b78b2-94c3-423c-baf7-1bf1cc027da5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:14.558496 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1d1b78b2-94c3-423c-baf7-1bf1cc027da5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:14.560616 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1d1b78b2-94c3-423c-baf7-1bf1cc027da5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:14.561776 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1d1b78b2-94c3-423c-baf7-1bf1cc027da5 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.154842 May 12 14:42:14.562340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 608/1195] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:14 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:15.579620 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a1fbefae-2e7d-4cd2-9f84-18ccd55d2462 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:15.580228 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a1fbefae-2e7d-4cd2-9f84-18ccd55d2462 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:15.586611 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a1fbefae-2e7d-4cd2-9f84-18ccd55d2462 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:15.587093 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a1fbefae-2e7d-4cd2-9f84-18ccd55d2462 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:15.587871 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a1fbefae-2e7d-4cd2-9f84-18ccd55d2462 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:15.588305 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a1fbefae-2e7d-4cd2-9f84-18ccd55d2462 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:15.719552 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a1fbefae-2e7d-4cd2-9f84-18ccd55d2462 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:15.727450 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a1fbefae-2e7d-4cd2-9f84-18ccd55d2462 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:15.728972 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a1fbefae-2e7d-4cd2-9f84-18ccd55d2462 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:15.730122 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a1fbefae-2e7d-4cd2-9f84-18ccd55d2462 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.154428 May 12 14:42:15.730739 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 588/1196] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:15 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:16.753830 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a695c31b-b85b-4459-8f03-daed0f55416e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:16.754466 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a695c31b-b85b-4459-8f03-daed0f55416e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:16.760618 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a695c31b-b85b-4459-8f03-daed0f55416e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:16.761078 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a695c31b-b85b-4459-8f03-daed0f55416e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:16.761999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a695c31b-b85b-4459-8f03-daed0f55416e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:16.762444 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a695c31b-b85b-4459-8f03-daed0f55416e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:16.889181 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a695c31b-b85b-4459-8f03-daed0f55416e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:16.897029 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a695c31b-b85b-4459-8f03-daed0f55416e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:16.898562 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a695c31b-b85b-4459-8f03-daed0f55416e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:16.899765 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a695c31b-b85b-4459-8f03-daed0f55416e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.155227 May 12 14:42:16.900332 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 609/1197] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:16 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:42:17.270359 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-70d35c31-87df-4756-83b7-0b1e17c57caa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-24117388"}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:17.270878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-70d35c31-87df-4756-83b7-0b1e17c57caa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:17.277255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-70d35c31-87df-4756-83b7-0b1e17c57caa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:17.278303 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-70d35c31-87df-4756-83b7-0b1e17c57caa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:17.279078 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-70d35c31-87df-4756-83b7-0b1e17c57caa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:17.279518 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-70d35c31-87df-4756-83b7-0b1e17c57caa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:17.400980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.network.security_group_api [None req-70d35c31-87df-4756-83b7-0b1e17c57caa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Removing security group 9d10a209-0295-4ced-8cf8-33b73d6c1ec1 from port 5dfbc34b-96be-4bb8-98e9-1380f31b1266 May 12 14:42:17.797122 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-70d35c31-87df-4756-83b7-0b1e17c57caa tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "POST /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.530687 May 12 14:42:17.797744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 589/1198] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 12 14:42:17 2022] POST /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:42:17.803532 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-8ccf7502-d64d-46ca-a567-b2af9ea8390b req-14221004-c989-4ba5-8c7b-2bf4b1e39b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7740cfd0-aec5-4a22-93f7-a460cadea4ac", "tag": "5dfbc34b-96be-4bb8-98e9-1380f31b1266"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:17.819051 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-8ccf7502-d64d-46ca-a567-b2af9ea8390b req-14221004-c989-4ba5-8c7b-2bf4b1e39b12 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:17.819541 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-8ccf7502-d64d-46ca-a567-b2af9ea8390b req-14221004-c989-4ba5-8c7b-2bf4b1e39b12 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:17.832699 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-8ccf7502-d64d-46ca-a567-b2af9ea8390b req-14221004-c989-4ba5-8c7b-2bf4b1e39b12 service nova] Creating event network-changed:5dfbc34b-96be-4bb8-98e9-1380f31b1266 for instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac on hv-cinder-77703 May 12 14:42:17.838223 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-8ccf7502-d64d-46ca-a567-b2af9ea8390b req-14221004-c989-4ba5-8c7b-2bf4b1e39b12 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038587 May 12 14:42:17.839194 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 610/1199] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:42:17.918229 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e27f737b-3a6f-4910-9ec1-9bd6c19f8a7e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:17.919219 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e27f737b-3a6f-4910-9ec1-9bd6c19f8a7e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:17.925471 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e27f737b-3a6f-4910-9ec1-9bd6c19f8a7e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:17.926003 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e27f737b-3a6f-4910-9ec1-9bd6c19f8a7e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:17.926798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e27f737b-3a6f-4910-9ec1-9bd6c19f8a7e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:17.927270 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e27f737b-3a6f-4910-9ec1-9bd6c19f8a7e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:18.183494 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e27f737b-3a6f-4910-9ec1-9bd6c19f8a7e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:18.212939 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e27f737b-3a6f-4910-9ec1-9bd6c19f8a7e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:18.216030 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e27f737b-3a6f-4910-9ec1-9bd6c19f8a7e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:18.217582 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e27f737b-3a6f-4910-9ec1-9bd6c19f8a7e tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.303371 May 12 14:42:18.218795 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 590/1200] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:17 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:19.237946 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-87cbdc77-22ee-4df0-b1f5-7dc1c9221f89 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:19.238706 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-87cbdc77-22ee-4df0-b1f5-7dc1c9221f89 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:19.251355 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-87cbdc77-22ee-4df0-b1f5-7dc1c9221f89 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:19.251818 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-87cbdc77-22ee-4df0-b1f5-7dc1c9221f89 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:19.252610 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-87cbdc77-22ee-4df0-b1f5-7dc1c9221f89 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:19.253055 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-87cbdc77-22ee-4df0-b1f5-7dc1c9221f89 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:19.254663 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-27e4fe04-87fb-4c6b-9fe3-8f93231fcb7b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:19.255183 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-27e4fe04-87fb-4c6b-9fe3-8f93231fcb7b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:19.262850 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-27e4fe04-87fb-4c6b-9fe3-8f93231fcb7b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:19.263332 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-27e4fe04-87fb-4c6b-9fe3-8f93231fcb7b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:19.264132 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-27e4fe04-87fb-4c6b-9fe3-8f93231fcb7b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:19.264572 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-27e4fe04-87fb-4c6b-9fe3-8f93231fcb7b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:19.354460 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-27e4fe04-87fb-4c6b-9fe3-8f93231fcb7b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lazy-loading 'services' on Instance uuid 7740cfd0-aec5-4a22-93f7-a460cadea4ac {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:42:19.423129 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-87cbdc77-22ee-4df0-b1f5-7dc1c9221f89 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:19.431496 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-87cbdc77-22ee-4df0-b1f5-7dc1c9221f89 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:19.432720 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-27e4fe04-87fb-4c6b-9fe3-8f93231fcb7b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "DELETE /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/os-volume_attachments/b2241aed-a978-49a1-a8d0-a0883e28fe13" status: 202 len: 0 microversion: 2.1 time: 0.181698 May 12 14:42:19.433233 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-87cbdc77-22ee-4df0-b1f5-7dc1c9221f89 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:19.433396 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 591/1201] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 12 14:42:19 2022] DELETE /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/os-volume_attachments/b2241aed-a978-49a1-a8d0-a0883e28fe13 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 14:42:19.436659 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-87cbdc77-22ee-4df0-b1f5-7dc1c9221f89 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.203842 May 12 14:42:19.439257 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-5df90cac-b6d7-41b7-93f3-cffb13d67648 req-dce22bd7-af6e-48ce-95eb-4b5cd0ab9fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7740cfd0-aec5-4a22-93f7-a460cadea4ac", "tag": "5dfbc34b-96be-4bb8-98e9-1380f31b1266"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:19.447911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-5df90cac-b6d7-41b7-93f3-cffb13d67648 req-dce22bd7-af6e-48ce-95eb-4b5cd0ab9fe8 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:19.448346 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-5df90cac-b6d7-41b7-93f3-cffb13d67648 req-dce22bd7-af6e-48ce-95eb-4b5cd0ab9fe8 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:19.448806 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 611/1202] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:19 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:19.454954 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c2f03417-5604-4752-be1d-589474ea0753 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:19.456301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c2f03417-5604-4752-be1d-589474ea0753 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:19.462439 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-5df90cac-b6d7-41b7-93f3-cffb13d67648 req-dce22bd7-af6e-48ce-95eb-4b5cd0ab9fe8 service nova] Creating event network-changed:5dfbc34b-96be-4bb8-98e9-1380f31b1266 for instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac on hv-cinder-77703 May 12 14:42:19.464408 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c2f03417-5604-4752-be1d-589474ea0753 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:19.466063 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c2f03417-5604-4752-be1d-589474ea0753 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:19.468730 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-5df90cac-b6d7-41b7-93f3-cffb13d67648 req-dce22bd7-af6e-48ce-95eb-4b5cd0ab9fe8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033779 May 12 14:42:19.469369 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 592/1203] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:42:19.470220 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c2f03417-5604-4752-be1d-589474ea0753 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:19.470752 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c2f03417-5604-4752-be1d-589474ea0753 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:19.500111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c2f03417-5604-4752-be1d-589474ea0753 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049101 May 12 14:42:19.500786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 612/1204] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:42:19 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:42:20.413463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-bf0b414d-331c-412b-875b-515c848872d6 req-d8390337-c657-446e-9112-a088f7c91cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533a547e-b44f-4a33-8725-24b323556322", "name": "network-vif-plugged", "status": "completed", "tag": "152a3c94-4ce4-4682-a2c1-1ad44f9d899e"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:20.422472 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-bf0b414d-331c-412b-875b-515c848872d6 req-d8390337-c657-446e-9112-a088f7c91cc7 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:20.422717 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-bf0b414d-331c-412b-875b-515c848872d6 req-d8390337-c657-446e-9112-a088f7c91cc7 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:20.435351 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-bf0b414d-331c-412b-875b-515c848872d6 req-d8390337-c657-446e-9112-a088f7c91cc7 service nova] Creating event network-vif-plugged:152a3c94-4ce4-4682-a2c1-1ad44f9d899e for instance 533a547e-b44f-4a33-8725-24b323556322 on hv-cinder-77703 May 12 14:42:20.440081 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-bf0b414d-331c-412b-875b-515c848872d6 req-d8390337-c657-446e-9112-a088f7c91cc7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031334 May 12 14:42:20.440675 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 593/1205] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:42:20.455596 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0c781dd3-bc02-473a-8dc8-88f2bc412f83 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:20.456088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0c781dd3-bc02-473a-8dc8-88f2bc412f83 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:20.468780 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0c781dd3-bc02-473a-8dc8-88f2bc412f83 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:20.470676 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0c781dd3-bc02-473a-8dc8-88f2bc412f83 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:20.472094 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0c781dd3-bc02-473a-8dc8-88f2bc412f83 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:20.472553 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0c781dd3-bc02-473a-8dc8-88f2bc412f83 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:20.513264 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-67041e50-e04d-4e26-a899-bfc4ccff5c74 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:20.514319 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-67041e50-e04d-4e26-a899-bfc4ccff5c74 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:20.520949 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-67041e50-e04d-4e26-a899-bfc4ccff5c74 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:20.521410 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-67041e50-e04d-4e26-a899-bfc4ccff5c74 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:20.522202 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-67041e50-e04d-4e26-a899-bfc4ccff5c74 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:20.522645 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-67041e50-e04d-4e26-a899-bfc4ccff5c74 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:20.555728 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-67041e50-e04d-4e26-a899-bfc4ccff5c74 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047198 May 12 14:42:20.556327 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 594/1206] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:42:20 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:42:20.665738 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0c781dd3-bc02-473a-8dc8-88f2bc412f83 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:20.673745 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0c781dd3-bc02-473a-8dc8-88f2bc412f83 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:20.675317 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0c781dd3-bc02-473a-8dc8-88f2bc412f83 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:20.676507 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0c781dd3-bc02-473a-8dc8-88f2bc412f83 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.225061 May 12 14:42:20.677081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 613/1207] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:20 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:21.568221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1d66cb08-a7f9-47cc-a3dd-308cdad8de69 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:21.569072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1d66cb08-a7f9-47cc-a3dd-308cdad8de69 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:21.575365 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1d66cb08-a7f9-47cc-a3dd-308cdad8de69 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:21.575829 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1d66cb08-a7f9-47cc-a3dd-308cdad8de69 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:21.576610 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1d66cb08-a7f9-47cc-a3dd-308cdad8de69 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:21.577083 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1d66cb08-a7f9-47cc-a3dd-308cdad8de69 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:21.607260 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1d66cb08-a7f9-47cc-a3dd-308cdad8de69 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043094 May 12 14:42:21.607847 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 595/1208] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:42:21 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:42:21.694472 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-217ee9f6-f23a-4b77-915e-480d20e39bce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:21.695110 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-217ee9f6-f23a-4b77-915e-480d20e39bce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:21.701997 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-217ee9f6-f23a-4b77-915e-480d20e39bce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:21.702458 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-217ee9f6-f23a-4b77-915e-480d20e39bce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:21.703255 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-217ee9f6-f23a-4b77-915e-480d20e39bce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:21.703694 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-217ee9f6-f23a-4b77-915e-480d20e39bce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:21.833164 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-217ee9f6-f23a-4b77-915e-480d20e39bce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:21.842041 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-217ee9f6-f23a-4b77-915e-480d20e39bce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:21.843567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-217ee9f6-f23a-4b77-915e-480d20e39bce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:21.844755 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-217ee9f6-f23a-4b77-915e-480d20e39bce tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.154190 May 12 14:42:21.845310 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 614/1209] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:21 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:22.619447 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-cc349d96-688e-468d-9d20-a3e9c4315ba1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:22.620370 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-cc349d96-688e-468d-9d20-a3e9c4315ba1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:22.627255 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cc349d96-688e-468d-9d20-a3e9c4315ba1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:22.627708 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cc349d96-688e-468d-9d20-a3e9c4315ba1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:22.628478 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cc349d96-688e-468d-9d20-a3e9c4315ba1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:22.628911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cc349d96-688e-468d-9d20-a3e9c4315ba1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:22.655648 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-cc349d96-688e-468d-9d20-a3e9c4315ba1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040687 May 12 14:42:22.656207 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 596/1210] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:42:22 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:42:22.665901 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-dc099489-258a-4423-b741-4cfa4927a06f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:22.666525 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-dc099489-258a-4423-b741-4cfa4927a06f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:22.672978 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dc099489-258a-4423-b741-4cfa4927a06f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:22.673430 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dc099489-258a-4423-b741-4cfa4927a06f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:22.674259 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dc099489-258a-4423-b741-4cfa4927a06f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:22.674692 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-dc099489-258a-4423-b741-4cfa4927a06f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:22.746931 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-dc099489-258a-4423-b741-4cfa4927a06f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] HTTP exception thrown: Instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac is not attached to volume b2241aed-a978-49a1-a8d0-a0883e28fe13 May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-dc099489-258a-4423-b741-4cfa4927a06f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Request method failure captured: May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: DELETE /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/os-volume_attachments/b2241aed-a978-49a1-a8d0-a0883e28fe13 HTTP/1.1 May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRvCyhxpOskqobrX_-9sS5cQQNHcsb0_xhzFPOLaGOGOp8rMzadDwRGdrE8P2wW0SrkYnoAPqJl-EpvqXSwbLy9wJl9wOzji7QLAZcruzZC816ZSO0-Bh_s3eJYBzl2zv70nzqFDP2e-X-AAliLIGBP1ho9JcyvJrPvS0RJk-NOKets May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 9462307fa603476baafa1c5c8ae491d5 May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-TestMinimumBasicScenario-2048200261 May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:42:22.756583 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:42:22.758258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9462307fa603476baafa1c5c8ae491d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9462307fa603476baafa1c5c8ae491d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9462307fa603476baafa1c5c8ae491d5", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9462307fa603476baafa1c5c8ae491d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:42:22.758258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-TestMinimumBasicScenario-2048200261 May 12 14:42:22.758258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 9462307fa603476baafa1c5c8ae491d5 May 12 14:42:22.758258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2048200261 May 12 14:42:22.758258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-TestMinimumBasicScenario-2048200261-project May 12 14:42:22.758258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:42:22.758258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:42:22.758258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: e3a87d665be74a73ae84e15c39b735ad May 12 14:42:22.758258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-TestMinimumBasicScenario-2048200261-project May 12 14:42:22.758258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:42:22.758258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac is not attached to volume b2241aed-a978-49a1-a8d0-a0883e28fe13 May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'server_id': '7740cfd0-aec5-4a22-93f7-a460cadea4ac', 'id': 'b2241aed-a978-49a1-a8d0-a0883e28fe13'} May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b2241aed-a978-49a1-a8d0-a0883e28fe13. May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:42:22.759190 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:42:22.760822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:42:22.760822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 12 14:42:22.760822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 12 14:42:22.760822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac is not attached to volume b2241aed-a978-49a1-a8d0-a0883e28fe13 May 12 14:42:22.760822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:42:22.760822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:42:22.760822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:42:22.760822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:42:22.760822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:42:22.760822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:42:22.760822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:42:22.760822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:42:22.760822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac is not attached to volume b2241aed-a978-49a1-a8d0-a0883e28fe13 May 12 14:42:22.760822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:42:22.760822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-dc099489-258a-4423-b741-4cfa4927a06f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Returning 404 to user: Instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac is not attached to volume b2241aed-a978-49a1-a8d0-a0883e28fe13 {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:42:22.761968 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-dc099489-258a-4423-b741-4cfa4927a06f tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "DELETE /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/os-volume_attachments/b2241aed-a978-49a1-a8d0-a0883e28fe13" status: 404 len: 154 microversion: 2.1 time: 0.096209 May 12 14:42:22.761968 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 615/1211] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 12 14:42:22 2022] DELETE /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac/os-volume_attachments/b2241aed-a978-49a1-a8d0-a0883e28fe13 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:42:22.862559 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d686c630-e897-4c1f-8d57-5d0b1284a0b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:22.863344 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d686c630-e897-4c1f-8d57-5d0b1284a0b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:22.869786 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d686c630-e897-4c1f-8d57-5d0b1284a0b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:22.870213 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d686c630-e897-4c1f-8d57-5d0b1284a0b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:22.870994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d686c630-e897-4c1f-8d57-5d0b1284a0b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:22.871468 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d686c630-e897-4c1f-8d57-5d0b1284a0b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:23.002934 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d686c630-e897-4c1f-8d57-5d0b1284a0b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:23.010741 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d686c630-e897-4c1f-8d57-5d0b1284a0b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:23.012297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d686c630-e897-4c1f-8d57-5d0b1284a0b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:23.013444 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d686c630-e897-4c1f-8d57-5d0b1284a0b3 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1731 microversion: 2.20 time: 0.155217 May 12 14:42:23.014002 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 597/1212] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:22 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:23.892733 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8d80a3da-5c78-41d8-9785-fe18514394f9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:23.893228 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8d80a3da-5c78-41d8-9785-fe18514394f9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:23.900569 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d80a3da-5c78-41d8-9785-fe18514394f9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:23.901023 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d80a3da-5c78-41d8-9785-fe18514394f9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:23.901792 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d80a3da-5c78-41d8-9785-fe18514394f9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:23.902233 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8d80a3da-5c78-41d8-9785-fe18514394f9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:23.928140 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8d80a3da-5c78-41d8-9785-fe18514394f9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Going to try to terminate instance {{(pid=118217) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:42:24.005890 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8d80a3da-5c78-41d8-9785-fe18514394f9 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "DELETE /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 204 len: 0 microversion: 2.1 time: 0.116538 May 12 14:42:24.006705 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 616/1213] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:42:23 2022] DELETE /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:42:24.015991 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-15c6a117-3f37-4f01-abf6-6905fe928530 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:24.017217 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-15c6a117-3f37-4f01-abf6-6905fe928530 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:24.023630 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-15c6a117-3f37-4f01-abf6-6905fe928530 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:24.024079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-15c6a117-3f37-4f01-abf6-6905fe928530 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:24.024853 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-15c6a117-3f37-4f01-abf6-6905fe928530 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:24.025287 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-15c6a117-3f37-4f01-abf6-6905fe928530 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:24.032724 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f3ff19e6-cc1a-4388-b533-5659aced303c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:24.033429 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f3ff19e6-cc1a-4388-b533-5659aced303c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:24.039331 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f3ff19e6-cc1a-4388-b533-5659aced303c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:24.039775 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f3ff19e6-cc1a-4388-b533-5659aced303c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:24.040552 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f3ff19e6-cc1a-4388-b533-5659aced303c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:24.041002 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f3ff19e6-cc1a-4388-b533-5659aced303c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:24.215894 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-15c6a117-3f37-4f01-abf6-6905fe928530 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:24.219626 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f3ff19e6-cc1a-4388-b533-5659aced303c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:24.223137 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-15c6a117-3f37-4f01-abf6-6905fe928530 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1553 microversion: 2.1 time: 0.211885 May 12 14:42:24.223711 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 598/1214] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:42:24 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:24.228686 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f3ff19e6-cc1a-4388-b533-5659aced303c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:24.230189 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f3ff19e6-cc1a-4388-b533-5659aced303c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:24.231903 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f3ff19e6-cc1a-4388-b533-5659aced303c tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1718 microversion: 2.20 time: 0.204296 May 12 14:42:24.232453 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 617/1215] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:42:24 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1718 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:42:25.240834 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ae5f5087-3695-48e0-844b-5cf2ada46010 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:25.241363 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ae5f5087-3695-48e0-844b-5cf2ada46010 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:25.248447 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ae5f5087-3695-48e0-844b-5cf2ada46010 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:25.248891 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ae5f5087-3695-48e0-844b-5cf2ada46010 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:25.249650 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ae5f5087-3695-48e0-844b-5cf2ada46010 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:25.250080 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ae5f5087-3695-48e0-844b-5cf2ada46010 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:25.372884 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ae5f5087-3695-48e0-844b-5cf2ada46010 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:25.380166 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ae5f5087-3695-48e0-844b-5cf2ada46010 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1553 microversion: 2.1 time: 0.143306 May 12 14:42:25.380737 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 599/1216] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:42:25 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1553 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:26.397648 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-72743274-1d4d-4ad9-ab48-10f0375d23b1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:26.398276 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-72743274-1d4d-4ad9-ab48-10f0375d23b1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:26.405273 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-72743274-1d4d-4ad9-ab48-10f0375d23b1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:26.405730 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-72743274-1d4d-4ad9-ab48-10f0375d23b1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:26.406503 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-72743274-1d4d-4ad9-ab48-10f0375d23b1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:26.406948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-72743274-1d4d-4ad9-ab48-10f0375d23b1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:26.549867 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-72743274-1d4d-4ad9-ab48-10f0375d23b1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a87d665be74a73ae84e15c39b735ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9462307fa603476baafa1c5c8ae491d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:42:26.557219 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-72743274-1d4d-4ad9-ab48-10f0375d23b1 tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 200 len: 1553 microversion: 2.1 time: 0.163400 May 12 14:42:26.557799 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 618/1217] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:42:26 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:42:27.111844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-5ce51886-e689-420c-9136-fd5540d28db2 req-949a5d11-cbd0-4299-8726-c770013a370b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7740cfd0-aec5-4a22-93f7-a460cadea4ac", "name": "network-vif-deleted", "tag": "5dfbc34b-96be-4bb8-98e9-1380f31b1266"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:42:27.120770 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-5ce51886-e689-420c-9136-fd5540d28db2 req-949a5d11-cbd0-4299-8726-c770013a370b service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:27.121217 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-5ce51886-e689-420c-9136-fd5540d28db2 req-949a5d11-cbd0-4299-8726-c770013a370b service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:27.132395 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-5ce51886-e689-420c-9136-fd5540d28db2 req-949a5d11-cbd0-4299-8726-c770013a370b service nova] Creating event network-vif-deleted:5dfbc34b-96be-4bb8-98e9-1380f31b1266 for instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac on hv-cinder-77703 May 12 14:42:27.137718 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-5ce51886-e689-420c-9136-fd5540d28db2 req-949a5d11-cbd0-4299-8726-c770013a370b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151141 May 12 14:42:27.138309 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 600/1218] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:42:27.576325 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7f5c5901-3506-4a1c-9ed6-689ed50a472a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:27.577019 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7f5c5901-3506-4a1c-9ed6-689ed50a472a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] [instance: 7740cfd0-aec5-4a22-93f7-a460cadea4ac] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:42:27.583401 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7f5c5901-3506-4a1c-9ed6-689ed50a472a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:27.583844 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7f5c5901-3506-4a1c-9ed6-689ed50a472a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:27.584652 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7f5c5901-3506-4a1c-9ed6-689ed50a472a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:42:27.585093 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7f5c5901-3506-4a1c-9ed6-689ed50a472a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:42:27.598207 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-7f5c5901-3506-4a1c-9ed6-689ed50a472a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] HTTP exception thrown: Instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac could not be found. May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7f5c5901-3506-4a1c-9ed6-689ed50a472a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Request method failure captured: May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac HTTP/1.1 May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRvCyhxpOskqobrX_-9sS5cQQNHcsb0_xhzFPOLaGOGOp8rMzadDwRGdrE8P2wW0SrkYnoAPqJl-EpvqXSwbLy9wJl9wOzji7QLAZcruzZC816ZSO0-Bh_s3eJYBzl2zv70nzqFDP2e-X-AAliLIGBP1ho9JcyvJrPvS0RJk-NOKets May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 9462307fa603476baafa1c5c8ae491d5 May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-TestMinimumBasicScenario-2048200261 May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:42:27.599883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:42:27.601449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9462307fa603476baafa1c5c8ae491d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9462307fa603476baafa1c5c8ae491d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9462307fa603476baafa1c5c8ae491d5", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9462307fa603476baafa1c5c8ae491d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:42:27.601449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-TestMinimumBasicScenario-2048200261 May 12 14:42:27.601449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 9462307fa603476baafa1c5c8ae491d5 May 12 14:42:27.601449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2048200261 May 12 14:42:27.601449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-TestMinimumBasicScenario-2048200261-project May 12 14:42:27.601449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:42:27.601449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:42:27.601449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: e3a87d665be74a73ae84e15c39b735ad May 12 14:42:27.601449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-TestMinimumBasicScenario-2048200261-project May 12 14:42:27.601449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:42:27.601449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac could not be found. May 12 14:42:27.601449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': '7740cfd0-aec5-4a22-93f7-a460cadea4ac'} May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac could not be found. May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:42:27.602373 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac could not be found. May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac could not be found. May 12 14:42:27.603870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:42:27.605167 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7f5c5901-3506-4a1c-9ed6-689ed50a472a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Returning 404 to user: Instance 7740cfd0-aec5-4a22-93f7-a460cadea4ac could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:42:27.605167 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7f5c5901-3506-4a1c-9ed6-689ed50a472a tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac" status: 404 len: 111 microversion: 2.1 time: 0.030239 May 12 14:42:27.605167 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 619/1219] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:42:27 2022] GET /compute/v2.1/servers/7740cfd0-aec5-4a22-93f7-a460cadea4ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:42:27.610580 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6708a0ea-101d-466e-989a-6861cce4083b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] Calling method '.version_select at 0x7f5b26206160>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:27.626884 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6708a0ea-101d-466e-989a-6861cce4083b tempest-TestMinimumBasicScenario-2048200261 tempest-TestMinimumBasicScenario-2048200261-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-352854606" status: 202 len: 0 microversion: 2.1 time: 0.020494 May 12 14:42:27.627468 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 601/1220] 10.222.0.75 () {58 vars in 1268 bytes} [Thu May 12 14:42:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-352854606 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:43:07.400207 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4857901c-5aa1-4022-aff1-c3ab14ba434b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:07.400754 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4857901c-5aa1-4022-aff1-c3ab14ba434b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:07.407050 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4857901c-5aa1-4022-aff1-c3ab14ba434b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:07.407523 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4857901c-5aa1-4022-aff1-c3ab14ba434b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:07.408332 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4857901c-5aa1-4022-aff1-c3ab14ba434b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:07.408773 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4857901c-5aa1-4022-aff1-c3ab14ba434b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:07.430936 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4857901c-5aa1-4022-aff1-c3ab14ba434b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261/ips" status: 200 len: 149 microversion: 2.1 time: 0.276158 May 12 14:43:07.431519 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 620/1221] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 12 14:43:07 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261/ips => generated 149 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:08.738910 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-09736bef-4466-4c87-86cd-b1208df8b288 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b888332-db61-4acf-bee1-1f818867a17f"}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:43:08.740238 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-09736bef-4466-4c87-86cd-b1208df8b288 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:08.746444 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-09736bef-4466-4c87-86cd-b1208df8b288 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:08.746895 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-09736bef-4466-4c87-86cd-b1208df8b288 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:08.747691 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-09736bef-4466-4c87-86cd-b1208df8b288 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:08.748129 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-09736bef-4466-4c87-86cd-b1208df8b288 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:09.010512 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-09736bef-4466-4c87-86cd-b1208df8b288 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "POST /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275894 May 12 14:43:09.011162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 602/1222] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 12 14:43:08 2022] POST /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:16.572714 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-02bf197f-0481-41a8-9738-5a3134cb5d74 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:16.573237 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-02bf197f-0481-41a8-9738-5a3134cb5d74 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:16.579643 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-02bf197f-0481-41a8-9738-5a3134cb5d74 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:16.580099 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-02bf197f-0481-41a8-9738-5a3134cb5d74 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:16.580861 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-02bf197f-0481-41a8-9738-5a3134cb5d74 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:16.581296 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-02bf197f-0481-41a8-9738-5a3134cb5d74 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:16.661960 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-02bf197f-0481-41a8-9738-5a3134cb5d74 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lazy-loading 'services' on Instance uuid b293e6a7-b82d-44db-af30-498fd91a7261 {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:43:16.730701 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-02bf197f-0481-41a8-9738-5a3134cb5d74 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261/os-volume_attachments/2b888332-db61-4acf-bee1-1f818867a17f" status: 202 len: 0 microversion: 2.1 time: 0.161614 May 12 14:43:16.731332 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 621/1223] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 12 14:43:16 2022] DELETE /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261/os-volume_attachments/2b888332-db61-4acf-bee1-1f818867a17f => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:43:16.740972 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-04df012d-4ecc-4f9b-accd-80cd577e4c4e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:16.742117 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-04df012d-4ecc-4f9b-accd-80cd577e4c4e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:16.749220 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-04df012d-4ecc-4f9b-accd-80cd577e4c4e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:16.749746 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-04df012d-4ecc-4f9b-accd-80cd577e4c4e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:16.750721 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-04df012d-4ecc-4f9b-accd-80cd577e4c4e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:16.751246 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-04df012d-4ecc-4f9b-accd-80cd577e4c4e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:16.780362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-04df012d-4ecc-4f9b-accd-80cd577e4c4e tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043871 May 12 14:43:16.781692 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 603/1224] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:43:16 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:17.792597 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-120b1272-37ea-422f-a0df-d957930f4f22 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:17.793598 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-120b1272-37ea-422f-a0df-d957930f4f22 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:17.800142 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-120b1272-37ea-422f-a0df-d957930f4f22 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:17.800592 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-120b1272-37ea-422f-a0df-d957930f4f22 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:17.801354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-120b1272-37ea-422f-a0df-d957930f4f22 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:17.801788 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-120b1272-37ea-422f-a0df-d957930f4f22 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:17.829740 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-120b1272-37ea-422f-a0df-d957930f4f22 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041525 May 12 14:43:17.830302 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 622/1225] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:43:17 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:43:17.886406 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d80d3dc3-f41d-439d-a8f6-b5f010e42c3b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:17.887365 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d80d3dc3-f41d-439d-a8f6-b5f010e42c3b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:17.896128 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d80d3dc3-f41d-439d-a8f6-b5f010e42c3b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:17.896656 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d80d3dc3-f41d-439d-a8f6-b5f010e42c3b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:17.899729 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d80d3dc3-f41d-439d-a8f6-b5f010e42c3b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:17.900182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d80d3dc3-f41d-439d-a8f6-b5f010e42c3b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:17.932347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d80d3dc3-f41d-439d-a8f6-b5f010e42c3b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Going to try to terminate instance {{(pid=118216) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:43:18.005679 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d80d3dc3-f41d-439d-a8f6-b5f010e42c3b tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 204 len: 0 microversion: 2.1 time: 0.122917 May 12 14:43:18.006273 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 604/1226] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:43:17 2022] DELETE /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:43:18.014509 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3da6a9d8-9a65-4ed1-9adb-974b2562ce85 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:18.015726 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3da6a9d8-9a65-4ed1-9adb-974b2562ce85 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:18.021475 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3da6a9d8-9a65-4ed1-9adb-974b2562ce85 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:18.021926 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3da6a9d8-9a65-4ed1-9adb-974b2562ce85 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:18.022687 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3da6a9d8-9a65-4ed1-9adb-974b2562ce85 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:18.023252 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3da6a9d8-9a65-4ed1-9adb-974b2562ce85 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:18.153833 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-3da6a9d8-9a65-4ed1-9adb-974b2562ce85 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:18.161142 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3da6a9d8-9a65-4ed1-9adb-974b2562ce85 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1680 microversion: 2.1 time: 0.150493 May 12 14:43:18.161712 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 623/1227] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:18 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:19.178692 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d719f18d-c4d9-4fe5-b8e4-460b6b3ab0c0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:19.179442 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d719f18d-c4d9-4fe5-b8e4-460b6b3ab0c0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:19.185686 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d719f18d-c4d9-4fe5-b8e4-460b6b3ab0c0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:19.186141 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d719f18d-c4d9-4fe5-b8e4-460b6b3ab0c0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:19.187555 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d719f18d-c4d9-4fe5-b8e4-460b6b3ab0c0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:19.188003 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d719f18d-c4d9-4fe5-b8e4-460b6b3ab0c0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:19.332103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d719f18d-c4d9-4fe5-b8e4-460b6b3ab0c0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:19.339442 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d719f18d-c4d9-4fe5-b8e4-460b6b3ab0c0 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1680 microversion: 2.1 time: 0.165082 May 12 14:43:19.340050 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 605/1228] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:19 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:43:20.357362 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-49c03e25-32af-4217-9697-557ecd74ed21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:20.358012 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-49c03e25-32af-4217-9697-557ecd74ed21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:20.367507 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-49c03e25-32af-4217-9697-557ecd74ed21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:20.367944 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-49c03e25-32af-4217-9697-557ecd74ed21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:20.368770 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-49c03e25-32af-4217-9697-557ecd74ed21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:20.369476 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-49c03e25-32af-4217-9697-557ecd74ed21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:20.667694 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-49c03e25-32af-4217-9697-557ecd74ed21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:20.674980 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-49c03e25-32af-4217-9697-557ecd74ed21 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1680 microversion: 2.1 time: 0.321690 May 12 14:43:20.675589 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 624/1229] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:20 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1680 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:21.325574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-2f6cda91-9ffd-4194-896f-2025691442ed req-9098e7ed-51d8-475d-8006-38bb4b248151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b293e6a7-b82d-44db-af30-498fd91a7261", "name": "network-vif-deleted", "tag": "72bdfac6-9a66-4d48-b364-b06fc90433ed"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:43:21.335472 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-2f6cda91-9ffd-4194-896f-2025691442ed req-9098e7ed-51d8-475d-8006-38bb4b248151 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:21.335921 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-2f6cda91-9ffd-4194-896f-2025691442ed req-9098e7ed-51d8-475d-8006-38bb4b248151 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:21.347359 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-2f6cda91-9ffd-4194-896f-2025691442ed req-9098e7ed-51d8-475d-8006-38bb4b248151 service nova] Creating event network-vif-deleted:72bdfac6-9a66-4d48-b364-b06fc90433ed for instance b293e6a7-b82d-44db-af30-498fd91a7261 on hv-cinder-77703 May 12 14:43:21.353230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-2f6cda91-9ffd-4194-896f-2025691442ed req-9098e7ed-51d8-475d-8006-38bb4b248151 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031289 May 12 14:43:21.354444 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 606/1230] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:21.691920 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7a9ca7de-dab2-4bb1-a9d9-f3b3d6f9cde9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:21.692559 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7a9ca7de-dab2-4bb1-a9d9-f3b3d6f9cde9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:21.699221 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7a9ca7de-dab2-4bb1-a9d9-f3b3d6f9cde9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:21.699675 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7a9ca7de-dab2-4bb1-a9d9-f3b3d6f9cde9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:21.700446 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7a9ca7de-dab2-4bb1-a9d9-f3b3d6f9cde9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:21.700883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7a9ca7de-dab2-4bb1-a9d9-f3b3d6f9cde9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:21.731349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7a9ca7de-dab2-4bb1-a9d9-f3b3d6f9cde9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:21.731801 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7a9ca7de-dab2-4bb1-a9d9-f3b3d6f9cde9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:21.732252 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-7a9ca7de-dab2-4bb1-a9d9-f3b3d6f9cde9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lazy-loading 'fault' on Instance uuid b293e6a7-b82d-44db-af30-498fd91a7261 {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:43:21.773343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7a9ca7de-dab2-4bb1-a9d9-f3b3d6f9cde9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6422873a3b84aac88f8a93291bcd7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b5ca018b5f4dda99486407424b8168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:21.781016 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7a9ca7de-dab2-4bb1-a9d9-f3b3d6f9cde9 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 200 len: 1331 microversion: 2.1 time: 0.092452 May 12 14:43:21.781589 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 625/1231] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:21 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:22.799702 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-af125608-8e42-45bf-be39-926838b83acf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:22.800400 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-af125608-8e42-45bf-be39-926838b83acf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:22.806552 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-af125608-8e42-45bf-be39-926838b83acf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:22.807176 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-af125608-8e42-45bf-be39-926838b83acf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:22.807986 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-af125608-8e42-45bf-be39-926838b83acf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:22.808433 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-af125608-8e42-45bf-be39-926838b83acf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:22.822151 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-af125608-8e42-45bf-be39-926838b83acf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] HTTP exception thrown: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-af125608-8e42-45bf-be39-926838b83acf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Request method failure captured: May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 HTTP/1.1 May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRo-ycWfHqPPxbmLiuTXrtXJLZwYU78oTuGhPDkiQSHU7CKcy_GQqpZ_HWFwpOkfP_a2cy2OZwfawJtQIkHx1tZyLxJZoQOwjSpujcF6pQ0BcV3O7kKLbSCm6-7BGei9mU5XP-t1FCFU5rK_O_aRKcjHsdbD5yR-8mP9_YNetCjLQkw May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:43:22.823798 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:43:22.825463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4b5ca018b5f4dda99486407424b8168", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:43:22.825463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:22.825463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:22.825463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:22.825463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:22.825463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:43:22.825463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:43:22.825463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: c6422873a3b84aac88f8a93291bcd7b0 May 12 14:43:22.825463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:22.825463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:43:22.825463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. May 12 14:43:22.825463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': 'b293e6a7-b82d-44db-af30-498fd91a7261'} May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:22.826353 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. May 12 14:43:22.827948 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:22.829298 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-af125608-8e42-45bf-be39-926838b83acf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Returning 404 to user: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:22.829298 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-af125608-8e42-45bf-be39-926838b83acf tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 404 len: 111 microversion: 2.1 time: 0.031150 May 12 14:43:22.829298 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 607/1232] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:22 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:43:22.835696 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8bcda6c1-19c4-4b43-80a9-23798749a191 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '.version_select at 0x7f5b2684fca0>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:22.854794 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8bcda6c1-19c4-4b43-80a9-23798749a191 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-160895428" status: 202 len: 0 microversion: 2.1 time: 0.024631 May 12 14:43:22.855396 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 626/1233] 10.222.0.75 () {58 vars in 1217 bytes} [Thu May 12 14:43:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-160895428 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 14:43:23.545283 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0ced008c-64d8-416c-9dc7-298a5bda1a54 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:23.545780 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0ced008c-64d8-416c-9dc7-298a5bda1a54 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:23.552248 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0ced008c-64d8-416c-9dc7-298a5bda1a54 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:23.552701 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0ced008c-64d8-416c-9dc7-298a5bda1a54 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:23.553488 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0ced008c-64d8-416c-9dc7-298a5bda1a54 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:23.554131 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0ced008c-64d8-416c-9dc7-298a5bda1a54 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:23.583377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0ced008c-64d8-416c-9dc7-298a5bda1a54 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/ips" status: 200 len: 145 microversion: 2.1 time: 0.041876 May 12 14:43:23.583949 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 608/1234] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 12 14:43:23 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:24.608007 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9ae23761-d01f-4959-83f6-f32d637a5f03 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:24.608705 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9ae23761-d01f-4959-83f6-f32d637a5f03 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:24.615094 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9ae23761-d01f-4959-83f6-f32d637a5f03 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:24.615557 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9ae23761-d01f-4959-83f6-f32d637a5f03 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:24.616337 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9ae23761-d01f-4959-83f6-f32d637a5f03 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:24.616785 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9ae23761-d01f-4959-83f6-f32d637a5f03 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:24.630069 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-9ae23761-d01f-4959-83f6-f32d637a5f03 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] HTTP exception thrown: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9ae23761-d01f-4959-83f6-f32d637a5f03 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Request method failure captured: May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: DELETE /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 HTTP/1.1 May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRo-ycWfHqPPxbmLiuTXrtXJLZwYU78oTuGhPDkiQSHU7CKcy_GQqpZ_HWFwpOkfP_a2cy2OZwfawJtQIkHx1tZyLxJZoQOwjSpujcF6pQ0BcV3O7kKLbSCm6-7BGei9mU5XP-t1FCFU5rK_O_aRKcjHsdbD5yR-8mP9_YNetCjLQkw May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:43:24.631784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:43:24.633439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4b5ca018b5f4dda99486407424b8168", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:43:24.633439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:24.633439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:24.633439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:24.633439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:24.633439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:43:24.633439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:43:24.633439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: c6422873a3b84aac88f8a93291bcd7b0 May 12 14:43:24.633439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:24.633439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:43:24.633439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. May 12 14:43:24.633439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': 'b293e6a7-b82d-44db-af30-498fd91a7261'} May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:24.634542 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. May 12 14:43:24.636060 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:24.637746 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9ae23761-d01f-4959-83f6-f32d637a5f03 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Returning 404 to user: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:24.637746 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9ae23761-d01f-4959-83f6-f32d637a5f03 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 404 len: 111 microversion: 2.1 time: 0.029708 May 12 14:43:24.637746 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 627/1235] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:43:24 2022] DELETE /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:43:24.642241 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4bbbc4ba-bf30-48ba-9f95-6afa536c4f66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:24.642862 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-4bbbc4ba-bf30-48ba-9f95-6afa536c4f66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: b293e6a7-b82d-44db-af30-498fd91a7261] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:24.649266 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4bbbc4ba-bf30-48ba-9f95-6afa536c4f66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:24.649720 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4bbbc4ba-bf30-48ba-9f95-6afa536c4f66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:24.650488 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4bbbc4ba-bf30-48ba-9f95-6afa536c4f66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:24.650929 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-4bbbc4ba-bf30-48ba-9f95-6afa536c4f66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:24.664846 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-4bbbc4ba-bf30-48ba-9f95-6afa536c4f66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] HTTP exception thrown: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4bbbc4ba-bf30-48ba-9f95-6afa536c4f66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Request method failure captured: May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 HTTP/1.1 May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRo-ycWfHqPPxbmLiuTXrtXJLZwYU78oTuGhPDkiQSHU7CKcy_GQqpZ_HWFwpOkfP_a2cy2OZwfawJtQIkHx1tZyLxJZoQOwjSpujcF6pQ0BcV3O7kKLbSCm6-7BGei9mU5XP-t1FCFU5rK_O_aRKcjHsdbD5yR-8mP9_YNetCjLQkw May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:43:24.666476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:43:24.668145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4b5ca018b5f4dda99486407424b8168", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:43:24.668145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:24.668145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:24.668145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:24.668145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:24.668145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:43:24.668145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:43:24.668145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: c6422873a3b84aac88f8a93291bcd7b0 May 12 14:43:24.668145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:24.668145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:43:24.668145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. May 12 14:43:24.668145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': 'b293e6a7-b82d-44db-af30-498fd91a7261'} May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:24.669221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. May 12 14:43:24.670680 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:24.672401 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-4bbbc4ba-bf30-48ba-9f95-6afa536c4f66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Returning 404 to user: Instance b293e6a7-b82d-44db-af30-498fd91a7261 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:24.672401 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-4bbbc4ba-bf30-48ba-9f95-6afa536c4f66 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261" status: 404 len: 111 microversion: 2.1 time: 0.030016 May 12 14:43:24.672401 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 609/1236] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:24 2022] GET /compute/v2.1/servers/b293e6a7-b82d-44db-af30-498fd91a7261 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:43:25.627186 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-6bcec9e3-bbbf-4b3f-9758-c677203894d5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3b456ee-dc97-4cd7-866f-24446109ee87"}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:43:25.628257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-6bcec9e3-bbbf-4b3f-9758-c677203894d5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:25.634851 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6bcec9e3-bbbf-4b3f-9758-c677203894d5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:25.635343 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6bcec9e3-bbbf-4b3f-9758-c677203894d5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:25.636124 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6bcec9e3-bbbf-4b3f-9758-c677203894d5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:25.636811 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6bcec9e3-bbbf-4b3f-9758-c677203894d5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:25.802103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3df2f881-8a10-4be5-b30a-88356d4c10fc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:25.802695 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3df2f881-8a10-4be5-b30a-88356d4c10fc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:25.809309 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3df2f881-8a10-4be5-b30a-88356d4c10fc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:25.809919 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3df2f881-8a10-4be5-b30a-88356d4c10fc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:25.810790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3df2f881-8a10-4be5-b30a-88356d4c10fc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:25.811442 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3df2f881-8a10-4be5-b30a-88356d4c10fc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:25.826065 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-3df2f881-8a10-4be5-b30a-88356d4c10fc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] HTTP exception thrown: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3df2f881-8a10-4be5-b30a-88356d4c10fc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Request method failure captured: May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: DELETE /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 HTTP/1.1 May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRo-ycWfHqPPxbmLiuTXrtXJLZwYU78oTuGhPDkiQSHU7CKcy_GQqpZ_HWFwpOkfP_a2cy2OZwfawJtQIkHx1tZyLxJZoQOwjSpujcF6pQ0BcV3O7kKLbSCm6-7BGei9mU5XP-t1FCFU5rK_O_aRKcjHsdbD5yR-8mP9_YNetCjLQkw May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:43:25.827745 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:43:25.829265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4b5ca018b5f4dda99486407424b8168", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:43:25.829265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:25.829265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:25.829265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:25.829265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:25.829265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:43:25.829265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:43:25.829265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: c6422873a3b84aac88f8a93291bcd7b0 May 12 14:43:25.829265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:25.829265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:43:25.829265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. May 12 14:43:25.829265 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '134a856e-1321-471c-bc31-43307ca41802'} May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:25.830182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. May 12 14:43:25.831435 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:25.832710 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3df2f881-8a10-4be5-b30a-88356d4c10fc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Returning 404 to user: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:25.832710 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3df2f881-8a10-4be5-b30a-88356d4c10fc tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 404 len: 111 microversion: 2.1 time: 0.031230 May 12 14:43:25.832710 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 610/1237] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:43:25 2022] DELETE /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:43:25.837537 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b977fb07-6179-4d26-9286-ec0d5d87d40d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:25.838157 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b977fb07-6179-4d26-9286-ec0d5d87d40d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 134a856e-1321-471c-bc31-43307ca41802] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:25.844687 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b977fb07-6179-4d26-9286-ec0d5d87d40d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:25.845432 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b977fb07-6179-4d26-9286-ec0d5d87d40d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:25.846689 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b977fb07-6179-4d26-9286-ec0d5d87d40d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:25.847466 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b977fb07-6179-4d26-9286-ec0d5d87d40d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:25.872088 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-b977fb07-6179-4d26-9286-ec0d5d87d40d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] HTTP exception thrown: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b977fb07-6179-4d26-9286-ec0d5d87d40d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Request method failure captured: May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 HTTP/1.1 May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRo-ycWfHqPPxbmLiuTXrtXJLZwYU78oTuGhPDkiQSHU7CKcy_GQqpZ_HWFwpOkfP_a2cy2OZwfawJtQIkHx1tZyLxJZoQOwjSpujcF6pQ0BcV3O7kKLbSCm6-7BGei9mU5XP-t1FCFU5rK_O_aRKcjHsdbD5yR-8mP9_YNetCjLQkw May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:43:25.875053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:43:25.876441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4b5ca018b5f4dda99486407424b8168", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:43:25.876441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:25.876441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:25.876441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:25.876441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:25.876441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:43:25.876441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:43:25.876441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: c6422873a3b84aac88f8a93291bcd7b0 May 12 14:43:25.876441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:25.876441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:43:25.876441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. May 12 14:43:25.876441 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '134a856e-1321-471c-bc31-43307ca41802'} May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:25.877181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. May 12 14:43:25.878379 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:25.879576 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b977fb07-6179-4d26-9286-ec0d5d87d40d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Returning 404 to user: Instance 134a856e-1321-471c-bc31-43307ca41802 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:25.879576 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b977fb07-6179-4d26-9286-ec0d5d87d40d tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802" status: 404 len: 111 microversion: 2.1 time: 0.042972 May 12 14:43:25.879576 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 611/1238] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:25 2022] GET /compute/v2.1/servers/134a856e-1321-471c-bc31-43307ca41802 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:43:25.887333 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-63c2b482-ce3b-4096-862e-162f2cbeaf44 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:25.888023 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-63c2b482-ce3b-4096-862e-162f2cbeaf44 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:25.895791 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-63c2b482-ce3b-4096-862e-162f2cbeaf44 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:25.896424 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-63c2b482-ce3b-4096-862e-162f2cbeaf44 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:25.897523 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-63c2b482-ce3b-4096-862e-162f2cbeaf44 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:25.898141 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-63c2b482-ce3b-4096-862e-162f2cbeaf44 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:25.916694 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-6bcec9e3-bbbf-4b3f-9758-c677203894d5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "POST /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293308 May 12 14:43:25.917376 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 628/1239] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 12 14:43:25 2022] POST /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:25.918408 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-63c2b482-ce3b-4096-862e-162f2cbeaf44 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] HTTP exception thrown: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-63c2b482-ce3b-4096-862e-162f2cbeaf44 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Request method failure captured: May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: DELETE /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 HTTP/1.1 May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRo-ycWfHqPPxbmLiuTXrtXJLZwYU78oTuGhPDkiQSHU7CKcy_GQqpZ_HWFwpOkfP_a2cy2OZwfawJtQIkHx1tZyLxJZoQOwjSpujcF6pQ0BcV3O7kKLbSCm6-7BGei9mU5XP-t1FCFU5rK_O_aRKcjHsdbD5yR-8mP9_YNetCjLQkw May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:43:25.921583 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:43:25.922980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4b5ca018b5f4dda99486407424b8168", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:43:25.922980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:25.922980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:25.922980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:25.922980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:25.922980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:43:25.922980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:43:25.922980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: c6422873a3b84aac88f8a93291bcd7b0 May 12 14:43:25.922980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:25.922980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:43:25.922980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. May 12 14:43:25.922980 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '6a95d03a-223b-49bc-ba3a-afc4119c02c1'} May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:25.924115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. May 12 14:43:25.925654 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:25.927159 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-63c2b482-ce3b-4096-862e-162f2cbeaf44 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Returning 404 to user: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:25.927159 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-63c2b482-ce3b-4096-862e-162f2cbeaf44 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 404 len: 111 microversion: 2.1 time: 0.041334 May 12 14:43:25.927159 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 612/1240] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:43:25 2022] DELETE /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:43:25.933441 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1af64af9-efcd-4879-b62a-ef0ae01271cd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:25.934252 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1af64af9-efcd-4879-b62a-ef0ae01271cd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 6a95d03a-223b-49bc-ba3a-afc4119c02c1] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:25.941775 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1af64af9-efcd-4879-b62a-ef0ae01271cd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:25.942307 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1af64af9-efcd-4879-b62a-ef0ae01271cd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:25.943242 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1af64af9-efcd-4879-b62a-ef0ae01271cd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:25.943615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1af64af9-efcd-4879-b62a-ef0ae01271cd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:25.958341 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-1af64af9-efcd-4879-b62a-ef0ae01271cd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] HTTP exception thrown: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1af64af9-efcd-4879-b62a-ef0ae01271cd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Request method failure captured: May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 HTTP/1.1 May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRo-ycWfHqPPxbmLiuTXrtXJLZwYU78oTuGhPDkiQSHU7CKcy_GQqpZ_HWFwpOkfP_a2cy2OZwfawJtQIkHx1tZyLxJZoQOwjSpujcF6pQ0BcV3O7kKLbSCm6-7BGei9mU5XP-t1FCFU5rK_O_aRKcjHsdbD5yR-8mP9_YNetCjLQkw May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:43:25.962779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:43:25.964468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4b5ca018b5f4dda99486407424b8168", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:43:25.964468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:25.964468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:25.964468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:25.964468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:25.964468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:43:25.964468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:43:25.964468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: c6422873a3b84aac88f8a93291bcd7b0 May 12 14:43:25.964468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:25.964468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:43:25.964468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. May 12 14:43:25.964468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': '6a95d03a-223b-49bc-ba3a-afc4119c02c1'} May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:25.965406 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. May 12 14:43:25.967008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:25.968242 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1af64af9-efcd-4879-b62a-ef0ae01271cd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Returning 404 to user: Instance 6a95d03a-223b-49bc-ba3a-afc4119c02c1 could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:25.968242 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1af64af9-efcd-4879-b62a-ef0ae01271cd tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1" status: 404 len: 111 microversion: 2.1 time: 0.032224 May 12 14:43:25.968242 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 629/1241] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:25 2022] GET /compute/v2.1/servers/6a95d03a-223b-49bc-ba3a-afc4119c02c1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:43:27.112348 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9bc4642e-8aff-4cbd-bc1b-b27dd24a2d39 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:27.112855 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9bc4642e-8aff-4cbd-bc1b-b27dd24a2d39 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:27.119543 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9bc4642e-8aff-4cbd-bc1b-b27dd24a2d39 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:27.120000 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9bc4642e-8aff-4cbd-bc1b-b27dd24a2d39 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:27.120780 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9bc4642e-8aff-4cbd-bc1b-b27dd24a2d39 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:27.121222 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9bc4642e-8aff-4cbd-bc1b-b27dd24a2d39 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:27.134928 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-9bc4642e-8aff-4cbd-bc1b-b27dd24a2d39 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] HTTP exception thrown: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9bc4642e-8aff-4cbd-bc1b-b27dd24a2d39 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Request method failure captured: May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: DELETE /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 HTTP/1.1 May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRo-ycWfHqPPxbmLiuTXrtXJLZwYU78oTuGhPDkiQSHU7CKcy_GQqpZ_HWFwpOkfP_a2cy2OZwfawJtQIkHx1tZyLxJZoQOwjSpujcF6pQ0BcV3O7kKLbSCm6-7BGei9mU5XP-t1FCFU5rK_O_aRKcjHsdbD5yR-8mP9_YNetCjLQkw May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:43:27.136413 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:43:27.138038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4b5ca018b5f4dda99486407424b8168", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:43:27.138038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:27.138038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:27.138038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:27.138038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:27.138038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:43:27.138038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:43:27.138038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: c6422873a3b84aac88f8a93291bcd7b0 May 12 14:43:27.138038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:27.138038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:43:27.138038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. May 12 14:43:27.138038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '1fab0a31-9c59-40c0-8350-788bf0458078'} May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:27.142063 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. May 12 14:43:27.143579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:27.145073 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9bc4642e-8aff-4cbd-bc1b-b27dd24a2d39 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Returning 404 to user: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:27.145073 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9bc4642e-8aff-4cbd-bc1b-b27dd24a2d39 tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 404 len: 111 microversion: 2.1 time: 0.029320 May 12 14:43:27.145073 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 613/1242] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:43:27 2022] DELETE /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:43:27.146658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0b1a87ec-d552-43e5-8b79-053885b1cd2f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:27.147308 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0b1a87ec-d552-43e5-8b79-053885b1cd2f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] [instance: 1fab0a31-9c59-40c0-8350-788bf0458078] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:27.153248 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0b1a87ec-d552-43e5-8b79-053885b1cd2f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:27.153703 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0b1a87ec-d552-43e5-8b79-053885b1cd2f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:27.154467 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0b1a87ec-d552-43e5-8b79-053885b1cd2f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:27.154908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0b1a87ec-d552-43e5-8b79-053885b1cd2f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:27.167847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-0b1a87ec-d552-43e5-8b79-053885b1cd2f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] HTTP exception thrown: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0b1a87ec-d552-43e5-8b79-053885b1cd2f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Request method failure captured: May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 HTTP/1.1 May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRo-ycWfHqPPxbmLiuTXrtXJLZwYU78oTuGhPDkiQSHU7CKcy_GQqpZ_HWFwpOkfP_a2cy2OZwfawJtQIkHx1tZyLxJZoQOwjSpujcF6pQ0BcV3O7kKLbSCm6-7BGei9mU5XP-t1FCFU5rK_O_aRKcjHsdbD5yR-8mP9_YNetCjLQkw May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:43:27.169360 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:43:27.171000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e4b5ca018b5f4dda99486407424b8168", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e4b5ca018b5f4dda99486407424b8168"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:43:27.171000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:27.171000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: e4b5ca018b5f4dda99486407424b8168 May 12 14:43:27.171000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-523912070 May 12 14:43:27.171000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:27.171000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:43:27.171000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:43:27.171000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: c6422873a3b84aac88f8a93291bcd7b0 May 12 14:43:27.171000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-AttachVolumeNegativeTest-523912070-project May 12 14:43:27.171000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:43:27.171000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. May 12 14:43:27.171000 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': '1fab0a31-9c59-40c0-8350-788bf0458078'} May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:27.172109 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. May 12 14:43:27.173615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:27.175080 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0b1a87ec-d552-43e5-8b79-053885b1cd2f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] Returning 404 to user: Instance 1fab0a31-9c59-40c0-8350-788bf0458078 could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:27.175080 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0b1a87ec-d552-43e5-8b79-053885b1cd2f tempest-AttachVolumeNegativeTest-523912070 tempest-AttachVolumeNegativeTest-523912070-project] 10.222.0.75 "GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078" status: 404 len: 111 microversion: 2.1 time: 0.027857 May 12 14:43:27.175080 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 630/1243] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:27 2022] GET /compute/v2.1/servers/1fab0a31-9c59-40c0-8350-788bf0458078 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:43:31.336544 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3f142f5d-2902-4535-8085-e5380ed2d4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:31.338041 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3f142f5d-2902-4535-8085-e5380ed2d4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:31.345104 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3f142f5d-2902-4535-8085-e5380ed2d4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:31.345621 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3f142f5d-2902-4535-8085-e5380ed2d4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:31.346476 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3f142f5d-2902-4535-8085-e5380ed2d4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:31.347280 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3f142f5d-2902-4535-8085-e5380ed2d4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:31.377217 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3f142f5d-2902-4535-8085-e5380ed2d4ea tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045342 May 12 14:43:31.378121 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 614/1244] 10.222.0.75 () {60 vars in 1342 bytes} [Thu May 12 14:43:31 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:31.435194 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-57eb7600-52e8-4bca-87ba-823c68b2dd95 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:31.435709 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-57eb7600-52e8-4bca-87ba-823c68b2dd95 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:31.442458 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-57eb7600-52e8-4bca-87ba-823c68b2dd95 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:31.442923 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-57eb7600-52e8-4bca-87ba-823c68b2dd95 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:31.443747 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-57eb7600-52e8-4bca-87ba-823c68b2dd95 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:31.444217 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-57eb7600-52e8-4bca-87ba-823c68b2dd95 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:31.475439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-57eb7600-52e8-4bca-87ba-823c68b2dd95 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Going to try to terminate instance {{(pid=118217) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:43:31.558241 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-57eb7600-52e8-4bca-87ba-823c68b2dd95 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "DELETE /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 204 len: 0 microversion: 2.20 time: 0.126388 May 12 14:43:31.567813 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d3acea7a-e9c6-4123-8358-55c8b050a825 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:31.568458 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d3acea7a-e9c6-4123-8358-55c8b050a825 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:31.570996 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 631/1245] 10.222.0.75 () {60 vars in 1279 bytes} [Thu May 12 14:43:31 2022] DELETE /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 14:43:31.577834 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d3acea7a-e9c6-4123-8358-55c8b050a825 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:31.577834 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d3acea7a-e9c6-4123-8358-55c8b050a825 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:31.577834 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d3acea7a-e9c6-4123-8358-55c8b050a825 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:31.577834 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d3acea7a-e9c6-4123-8358-55c8b050a825 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:31.708501 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d3acea7a-e9c6-4123-8358-55c8b050a825 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:31.717095 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d3acea7a-e9c6-4123-8358-55c8b050a825 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:31.718950 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-d3acea7a-e9c6-4123-8358-55c8b050a825 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:31.720072 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d3acea7a-e9c6-4123-8358-55c8b050a825 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.156350 May 12 14:43:31.720625 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 615/1246] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:43:31 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:43:32.739838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1388e923-5b1a-48d2-a78e-86bbe0fa298b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:32.740634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1388e923-5b1a-48d2-a78e-86bbe0fa298b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:32.747707 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1388e923-5b1a-48d2-a78e-86bbe0fa298b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:32.748156 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1388e923-5b1a-48d2-a78e-86bbe0fa298b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:32.748959 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1388e923-5b1a-48d2-a78e-86bbe0fa298b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:32.749399 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1388e923-5b1a-48d2-a78e-86bbe0fa298b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:32.890364 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1388e923-5b1a-48d2-a78e-86bbe0fa298b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:32.899431 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1388e923-5b1a-48d2-a78e-86bbe0fa298b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:32.901187 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1388e923-5b1a-48d2-a78e-86bbe0fa298b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:32.902479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1388e923-5b1a-48d2-a78e-86bbe0fa298b tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.166874 May 12 14:43:32.903414 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 632/1247] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:43:32 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:43:33.921848 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-cf483ba8-3e31-4042-9a36-460a462c9585 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:33.922517 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-cf483ba8-3e31-4042-9a36-460a462c9585 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:33.929174 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cf483ba8-3e31-4042-9a36-460a462c9585 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:33.929827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cf483ba8-3e31-4042-9a36-460a462c9585 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:33.930620 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cf483ba8-3e31-4042-9a36-460a462c9585 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:33.931083 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cf483ba8-3e31-4042-9a36-460a462c9585 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:34.503821 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-30991f51-c52e-425a-9822-288646eb36cc tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:43:34.516438 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-30991f51-c52e-425a-9822-288646eb36cc tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:34.517210 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-30991f51-c52e-425a-9822-288646eb36cc tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:34.576753 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-cf483ba8-3e31-4042-9a36-460a462c9585 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:34.587951 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-cf483ba8-3e31-4042-9a36-460a462c9585 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:34.589809 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-cf483ba8-3e31-4042-9a36-460a462c9585 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:34.590430 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-30991f51-c52e-425a-9822-288646eb36cc tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Going to try to stop instance {{(pid=118217) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 14:43:34.592639 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-cf483ba8-3e31-4042-9a36-460a462c9585 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1724 microversion: 2.20 time: 0.675262 May 12 14:43:34.593328 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 616/1248] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:43:33 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1724 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:43:34.638132 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-30991f51-c52e-425a-9822-288646eb36cc tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "POST /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/action" status: 202 len: 0 microversion: 2.1 time: 0.138358 May 12 14:43:34.638696 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 633/1249] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 12 14:43:34 2022] POST /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 14:43:34.654800 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1a7b467e-8f74-4f03-a75f-ef3787283e0b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:34.655426 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1a7b467e-8f74-4f03-a75f-ef3787283e0b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:34.667825 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1a7b467e-8f74-4f03-a75f-ef3787283e0b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:34.668418 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1a7b467e-8f74-4f03-a75f-ef3787283e0b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:34.669253 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1a7b467e-8f74-4f03-a75f-ef3787283e0b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:34.669718 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1a7b467e-8f74-4f03-a75f-ef3787283e0b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:34.915051 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1a7b467e-8f74-4f03-a75f-ef3787283e0b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:34.929551 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1a7b467e-8f74-4f03-a75f-ef3787283e0b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1723 microversion: 2.1 time: 0.278723 May 12 14:43:34.940074 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 617/1250] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:34 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:35.415052 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-b25b65b1-e23c-44e6-b6be-26513a9bb83a req-f2e89b70-5740-49b4-a5f7-966cf54b1486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533a547e-b44f-4a33-8725-24b323556322", "name": "network-vif-deleted", "tag": "152a3c94-4ce4-4682-a2c1-1ad44f9d899e"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:43:35.424686 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-b25b65b1-e23c-44e6-b6be-26513a9bb83a req-f2e89b70-5740-49b4-a5f7-966cf54b1486 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:35.425398 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-b25b65b1-e23c-44e6-b6be-26513a9bb83a req-f2e89b70-5740-49b4-a5f7-966cf54b1486 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:35.436893 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-b25b65b1-e23c-44e6-b6be-26513a9bb83a req-f2e89b70-5740-49b4-a5f7-966cf54b1486 service nova] Creating event network-vif-deleted:152a3c94-4ce4-4682-a2c1-1ad44f9d899e for instance 533a547e-b44f-4a33-8725-24b323556322 on hv-cinder-77703 May 12 14:43:35.442042 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-b25b65b1-e23c-44e6-b6be-26513a9bb83a req-f2e89b70-5740-49b4-a5f7-966cf54b1486 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032300 May 12 14:43:35.443296 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 634/1251] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:35.614416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-68a86141-a377-4940-829b-2462a702045d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:35.615309 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-68a86141-a377-4940-829b-2462a702045d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:35.622311 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-68a86141-a377-4940-829b-2462a702045d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:35.629047 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-68a86141-a377-4940-829b-2462a702045d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:35.630543 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-68a86141-a377-4940-829b-2462a702045d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:35.632433 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-68a86141-a377-4940-829b-2462a702045d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:35.675752 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-68a86141-a377-4940-829b-2462a702045d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:35.676391 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-68a86141-a377-4940-829b-2462a702045d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:35.677011 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-68a86141-a377-4940-829b-2462a702045d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lazy-loading 'fault' on Instance uuid 533a547e-b44f-4a33-8725-24b323556322 {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:43:35.721093 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-68a86141-a377-4940-829b-2462a702045d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:35.730452 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-68a86141-a377-4940-829b-2462a702045d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:35.732056 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-68a86141-a377-4940-829b-2462a702045d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3b76edcb338405a9bf2f68e91dfacdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202791457f0749649e8cc096f6e43404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:35.733290 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-68a86141-a377-4940-829b-2462a702045d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 200 len: 1372 microversion: 2.20 time: 0.122987 May 12 14:43:35.733888 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 618/1252] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:43:35 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:43:35.948687 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e9ca0e3d-16dd-4eb0-95cb-87d1b4d635f8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:35.949308 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e9ca0e3d-16dd-4eb0-95cb-87d1b4d635f8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:35.957874 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e9ca0e3d-16dd-4eb0-95cb-87d1b4d635f8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:35.958559 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e9ca0e3d-16dd-4eb0-95cb-87d1b4d635f8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:35.960092 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e9ca0e3d-16dd-4eb0-95cb-87d1b4d635f8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:35.960766 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e9ca0e3d-16dd-4eb0-95cb-87d1b4d635f8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:36.122004 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e9ca0e3d-16dd-4eb0-95cb-87d1b4d635f8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:36.131974 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e9ca0e3d-16dd-4eb0-95cb-87d1b4d635f8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1723 microversion: 2.1 time: 0.187913 May 12 14:43:36.132838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 635/1253] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:35 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:36.751888 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6d26881f-ab8b-46f6-8aa9-c1df1f045e3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:36.752517 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6d26881f-ab8b-46f6-8aa9-c1df1f045e3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:36.759014 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6d26881f-ab8b-46f6-8aa9-c1df1f045e3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:36.759506 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6d26881f-ab8b-46f6-8aa9-c1df1f045e3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:36.760297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6d26881f-ab8b-46f6-8aa9-c1df1f045e3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:36.760738 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6d26881f-ab8b-46f6-8aa9-c1df1f045e3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:36.774683 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-6d26881f-ab8b-46f6-8aa9-c1df1f045e3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] HTTP exception thrown: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6d26881f-ab8b-46f6-8aa9-c1df1f045e3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Request method failure captured: May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 HTTP/1.1 May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRo-uJp52z69PBIo-4zHUdWF7-t-Ab26V5UjIPerI3OAHZhwILOp0LVDyRxgAqZEoaM_UIcwxBLAHR1bbULQUwZUINd52e34RDt87Frpc1A9LEqHtmRg0wW5_ct0GIROhbfPDVxbsdWhdyr07Es5UjF8qwi30yr63vAVMEbCRh2SBZg May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Openstack-Nova-Api-Version: 2.20 May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 202791457f0749649e8cc096f6e43404 May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:43:36.776269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:43:36.777999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/202791457f0749649e8cc096f6e43404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/202791457f0749649e8cc096f6e43404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_202791457f0749649e8cc096f6e43404", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/202791457f0749649e8cc096f6e43404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:43:36.777999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:43:36.777999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 202791457f0749649e8cc096f6e43404 May 12 14:43:36.777999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:43:36.777999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-AttachVolumeShelveTestJSON-2013624373-project May 12 14:43:36.777999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:43:36.777999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:43:36.777999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: c3b76edcb338405a9bf2f68e91dfacdd May 12 14:43:36.777999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2013624373-project May 12 14:43:36.777999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:43:36.777999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. May 12 14:43:36.777999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '533a547e-b44f-4a33-8725-24b323556322'} May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:36.778911 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. May 12 14:43:36.780347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:36.781511 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6d26881f-ab8b-46f6-8aa9-c1df1f045e3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Returning 404 to user: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:36.781511 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6d26881f-ab8b-46f6-8aa9-c1df1f045e3d tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 404 len: 111 microversion: 2.20 time: 0.030834 May 12 14:43:36.781511 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 619/1254] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:43:36 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:43:36.786711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-61d2418b-8fb5-4aaf-af84-39e102385206 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '.version_select at 0x7f5b269c3b80>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:36.803721 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-61d2418b-8fb5-4aaf-af84-39e102385206 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646045558" status: 204 len: 0 microversion: 2.20 time: 0.020766 May 12 14:43:36.804303 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 636/1255] 10.222.0.75 () {60 vars in 1261 bytes} [Thu May 12 14:43:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646045558 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 14:43:37.149671 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9553ee6f-928f-4513-a76a-50cef10272ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:37.150493 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9553ee6f-928f-4513-a76a-50cef10272ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:37.156556 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9553ee6f-928f-4513-a76a-50cef10272ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:37.157093 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9553ee6f-928f-4513-a76a-50cef10272ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:37.158059 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9553ee6f-928f-4513-a76a-50cef10272ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:37.158509 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9553ee6f-928f-4513-a76a-50cef10272ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:37.346368 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9553ee6f-928f-4513-a76a-50cef10272ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:37.355202 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9553ee6f-928f-4513-a76a-50cef10272ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1723 microversion: 2.1 time: 0.208969 May 12 14:43:37.356115 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 620/1256] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:37 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:38.373212 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b9124981-2da2-4975-8786-8f65089ff023 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:38.374341 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b9124981-2da2-4975-8786-8f65089ff023 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:38.380549 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9124981-2da2-4975-8786-8f65089ff023 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:38.381004 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9124981-2da2-4975-8786-8f65089ff023 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:38.381785 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9124981-2da2-4975-8786-8f65089ff023 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:38.382224 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b9124981-2da2-4975-8786-8f65089ff023 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:38.512160 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-b9124981-2da2-4975-8786-8f65089ff023 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:38.520530 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b9124981-2da2-4975-8786-8f65089ff023 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1723 microversion: 2.1 time: 0.151989 May 12 14:43:38.521096 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 637/1257] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:38 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:38.658344 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ffca2e9d-b47b-4e8e-99f9-70609b354111 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:38.658844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ffca2e9d-b47b-4e8e-99f9-70609b354111 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:38.666172 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ffca2e9d-b47b-4e8e-99f9-70609b354111 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:38.666726 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ffca2e9d-b47b-4e8e-99f9-70609b354111 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:38.667673 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ffca2e9d-b47b-4e8e-99f9-70609b354111 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:38.668194 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ffca2e9d-b47b-4e8e-99f9-70609b354111 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:38.683518 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-ffca2e9d-b47b-4e8e-99f9-70609b354111 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] HTTP exception thrown: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ffca2e9d-b47b-4e8e-99f9-70609b354111 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Request method failure captured: May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: DELETE /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 HTTP/1.1 May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRo-uJp52z69PBIo-4zHUdWF7-t-Ab26V5UjIPerI3OAHZhwILOp0LVDyRxgAqZEoaM_UIcwxBLAHR1bbULQUwZUINd52e34RDt87Frpc1A9LEqHtmRg0wW5_ct0GIROhbfPDVxbsdWhdyr07Es5UjF8qwi30yr63vAVMEbCRh2SBZg May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Openstack-Nova-Api-Version: 2.20 May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 202791457f0749649e8cc096f6e43404 May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:43:38.685235 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:43:38.687407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/202791457f0749649e8cc096f6e43404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/202791457f0749649e8cc096f6e43404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_202791457f0749649e8cc096f6e43404", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/202791457f0749649e8cc096f6e43404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:43:38.687407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:43:38.687407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 202791457f0749649e8cc096f6e43404 May 12 14:43:38.687407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:43:38.687407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-AttachVolumeShelveTestJSON-2013624373-project May 12 14:43:38.687407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:43:38.687407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:43:38.687407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: c3b76edcb338405a9bf2f68e91dfacdd May 12 14:43:38.687407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2013624373-project May 12 14:43:38.687407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:43:38.687407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. May 12 14:43:38.687407 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '533a547e-b44f-4a33-8725-24b323556322'} May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:38.688163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. May 12 14:43:38.689377 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:38.691639 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ffca2e9d-b47b-4e8e-99f9-70609b354111 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Returning 404 to user: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:38.691639 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ffca2e9d-b47b-4e8e-99f9-70609b354111 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "DELETE /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 404 len: 111 microversion: 2.20 time: 0.033213 May 12 14:43:38.691639 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 621/1258] 10.222.0.75 () {60 vars in 1279 bytes} [Thu May 12 14:43:38 2022] DELETE /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:43:38.696479 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b5c7d411-a1fc-453e-be41-907fddd9feca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:38.697092 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-b5c7d411-a1fc-453e-be41-907fddd9feca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: 533a547e-b44f-4a33-8725-24b323556322] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:38.702882 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b5c7d411-a1fc-453e-be41-907fddd9feca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:38.703376 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b5c7d411-a1fc-453e-be41-907fddd9feca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:38.704141 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b5c7d411-a1fc-453e-be41-907fddd9feca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:38.704575 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-b5c7d411-a1fc-453e-be41-907fddd9feca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:38.720562 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-b5c7d411-a1fc-453e-be41-907fddd9feca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] HTTP exception thrown: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b5c7d411-a1fc-453e-be41-907fddd9feca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Request method failure captured: May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 HTTP/1.1 May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRo-uJp52z69PBIo-4zHUdWF7-t-Ab26V5UjIPerI3OAHZhwILOp0LVDyRxgAqZEoaM_UIcwxBLAHR1bbULQUwZUINd52e34RDt87Frpc1A9LEqHtmRg0wW5_ct0GIROhbfPDVxbsdWhdyr07Es5UjF8qwi30yr63vAVMEbCRh2SBZg May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Openstack-Nova-Api-Version: 2.20 May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 202791457f0749649e8cc096f6e43404 May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:43:38.722183 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:43:38.724058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/202791457f0749649e8cc096f6e43404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/202791457f0749649e8cc096f6e43404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_202791457f0749649e8cc096f6e43404", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/202791457f0749649e8cc096f6e43404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:43:38.724058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:43:38.724058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 202791457f0749649e8cc096f6e43404 May 12 14:43:38.724058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:43:38.724058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-AttachVolumeShelveTestJSON-2013624373-project May 12 14:43:38.724058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:43:38.724058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:43:38.724058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: c3b76edcb338405a9bf2f68e91dfacdd May 12 14:43:38.724058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2013624373-project May 12 14:43:38.724058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:43:38.724058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. May 12 14:43:38.724058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': '533a547e-b44f-4a33-8725-24b323556322'} May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:38.725136 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. May 12 14:43:38.726717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:38.728053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-b5c7d411-a1fc-453e-be41-907fddd9feca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Returning 404 to user: Instance 533a547e-b44f-4a33-8725-24b323556322 could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:38.728053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-b5c7d411-a1fc-453e-be41-907fddd9feca tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322" status: 404 len: 111 microversion: 2.20 time: 0.030981 May 12 14:43:38.728053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 638/1259] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:43:38 2022] GET /compute/v2.1/servers/533a547e-b44f-4a33-8725-24b323556322 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:43:39.537527 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a6743067-baa9-4e00-9dd6-c51df33bb12d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:39.538293 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a6743067-baa9-4e00-9dd6-c51df33bb12d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:39.544110 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a6743067-baa9-4e00-9dd6-c51df33bb12d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:39.544562 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a6743067-baa9-4e00-9dd6-c51df33bb12d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:39.545340 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a6743067-baa9-4e00-9dd6-c51df33bb12d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:39.545788 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a6743067-baa9-4e00-9dd6-c51df33bb12d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:39.677821 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a6743067-baa9-4e00-9dd6-c51df33bb12d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:39.685668 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a6743067-baa9-4e00-9dd6-c51df33bb12d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1723 microversion: 2.1 time: 0.152280 May 12 14:43:39.686240 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 622/1260] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:39 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:39.857889 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-07e73d61-4082-4e71-9587-2a1356ddcfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:39.858425 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-07e73d61-4082-4e71-9587-2a1356ddcfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:39.864642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-07e73d61-4082-4e71-9587-2a1356ddcfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:39.865090 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-07e73d61-4082-4e71-9587-2a1356ddcfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:39.865847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-07e73d61-4082-4e71-9587-2a1356ddcfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:39.866279 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-07e73d61-4082-4e71-9587-2a1356ddcfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:39.880393 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-07e73d61-4082-4e71-9587-2a1356ddcfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] HTTP exception thrown: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-07e73d61-4082-4e71-9587-2a1356ddcfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Request method failure captured: May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: DELETE /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 HTTP/1.1 May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRo-uJp52z69PBIo-4zHUdWF7-t-Ab26V5UjIPerI3OAHZhwILOp0LVDyRxgAqZEoaM_UIcwxBLAHR1bbULQUwZUINd52e34RDt87Frpc1A9LEqHtmRg0wW5_ct0GIROhbfPDVxbsdWhdyr07Es5UjF8qwi30yr63vAVMEbCRh2SBZg May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Openstack-Nova-Api-Version: 2.20 May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 202791457f0749649e8cc096f6e43404 May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:43:39.881908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:43:39.883642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/202791457f0749649e8cc096f6e43404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/202791457f0749649e8cc096f6e43404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_202791457f0749649e8cc096f6e43404", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/202791457f0749649e8cc096f6e43404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:43:39.883642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:43:39.883642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 202791457f0749649e8cc096f6e43404 May 12 14:43:39.883642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:43:39.883642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-AttachVolumeShelveTestJSON-2013624373-project May 12 14:43:39.883642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:43:39.883642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:43:39.883642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: c3b76edcb338405a9bf2f68e91dfacdd May 12 14:43:39.883642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2013624373-project May 12 14:43:39.883642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:43:39.883642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. May 12 14:43:39.883642 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': 'd0e2a4c2-6255-4074-9a3c-e5159c3f7b87'} May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:39.884439 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. May 12 14:43:39.885711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:43:39.886940 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-07e73d61-4082-4e71-9587-2a1356ddcfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Returning 404 to user: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:39.886940 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-07e73d61-4082-4e71-9587-2a1356ddcfaf tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 404 len: 111 microversion: 2.20 time: 0.029241 May 12 14:43:39.886940 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 639/1261] 10.222.0.75 () {60 vars in 1279 bytes} [Thu May 12 14:43:39 2022] DELETE /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:43:39.892456 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e7e590b5-e736-4ef8-9728-22a11d553fd2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:39.893065 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e7e590b5-e736-4ef8-9728-22a11d553fd2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] [instance: d0e2a4c2-6255-4074-9a3c-e5159c3f7b87] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:39.899350 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7e590b5-e736-4ef8-9728-22a11d553fd2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:39.899802 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7e590b5-e736-4ef8-9728-22a11d553fd2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:39.900572 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7e590b5-e736-4ef8-9728-22a11d553fd2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:39.901012 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7e590b5-e736-4ef8-9728-22a11d553fd2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:39.914699 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-e7e590b5-e736-4ef8-9728-22a11d553fd2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] HTTP exception thrown: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e7e590b5-e736-4ef8-9728-22a11d553fd2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Request method failure captured: May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 HTTP/1.1 May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRo-uJp52z69PBIo-4zHUdWF7-t-Ab26V5UjIPerI3OAHZhwILOp0LVDyRxgAqZEoaM_UIcwxBLAHR1bbULQUwZUINd52e34RDt87Frpc1A9LEqHtmRg0wW5_ct0GIROhbfPDVxbsdWhdyr07Es5UjF8qwi30yr63vAVMEbCRh2SBZg May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Openstack-Nova-Api-Version: 2.20 May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 202791457f0749649e8cc096f6e43404 May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:43:39.916230 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:43:39.918277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/202791457f0749649e8cc096f6e43404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/202791457f0749649e8cc096f6e43404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_202791457f0749649e8cc096f6e43404", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/202791457f0749649e8cc096f6e43404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:43:39.918277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:43:39.918277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 202791457f0749649e8cc096f6e43404 May 12 14:43:39.918277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2013624373 May 12 14:43:39.918277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-AttachVolumeShelveTestJSON-2013624373-project May 12 14:43:39.918277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:43:39.918277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:43:39.918277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: c3b76edcb338405a9bf2f68e91dfacdd May 12 14:43:39.918277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2013624373-project May 12 14:43:39.918277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:43:39.918277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. May 12 14:43:39.918277 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': 'd0e2a4c2-6255-4074-9a3c-e5159c3f7b87'} May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:39.919221 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. May 12 14:43:39.920785 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:39.922240 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e7e590b5-e736-4ef8-9728-22a11d553fd2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] Returning 404 to user: Instance d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:39.922240 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e7e590b5-e736-4ef8-9728-22a11d553fd2 tempest-AttachVolumeShelveTestJSON-2013624373 tempest-AttachVolumeShelveTestJSON-2013624373-project] 10.222.0.75 "GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87" status: 404 len: 111 microversion: 2.20 time: 0.029758 May 12 14:43:39.922240 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 623/1262] 10.222.0.75 () {60 vars in 1276 bytes} [Thu May 12 14:43:39 2022] GET /compute/v2.1/servers/d0e2a4c2-6255-4074-9a3c-e5159c3f7b87 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:43:40.703173 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f0e53a50-a407-470f-b8cb-e80d8b92c45b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:40.703937 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f0e53a50-a407-470f-b8cb-e80d8b92c45b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:40.709803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f0e53a50-a407-470f-b8cb-e80d8b92c45b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:40.710249 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f0e53a50-a407-470f-b8cb-e80d8b92c45b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:40.711021 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f0e53a50-a407-470f-b8cb-e80d8b92c45b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:40.711488 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f0e53a50-a407-470f-b8cb-e80d8b92c45b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:40.845273 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f0e53a50-a407-470f-b8cb-e80d8b92c45b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:40.855046 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f0e53a50-a407-470f-b8cb-e80d8b92c45b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1723 microversion: 2.1 time: 0.155781 May 12 14:43:40.855622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 640/1263] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:40 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:41.873797 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-887b9acc-8fe6-4196-911a-c64d51f1ffcf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:41.874982 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-887b9acc-8fe6-4196-911a-c64d51f1ffcf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:41.887198 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-887b9acc-8fe6-4196-911a-c64d51f1ffcf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:41.888028 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-887b9acc-8fe6-4196-911a-c64d51f1ffcf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:41.889064 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-887b9acc-8fe6-4196-911a-c64d51f1ffcf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:41.889771 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-887b9acc-8fe6-4196-911a-c64d51f1ffcf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:42.110880 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-887b9acc-8fe6-4196-911a-c64d51f1ffcf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:42.119433 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-887b9acc-8fe6-4196-911a-c64d51f1ffcf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1723 microversion: 2.1 time: 0.249172 May 12 14:43:42.120375 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 624/1264] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:41 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:43.136854 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0abce0d1-8fbc-4d5b-9e66-4b0d5aba4281 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:43.137709 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0abce0d1-8fbc-4d5b-9e66-4b0d5aba4281 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:43.145223 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0abce0d1-8fbc-4d5b-9e66-4b0d5aba4281 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:43.145767 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0abce0d1-8fbc-4d5b-9e66-4b0d5aba4281 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:43.146805 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0abce0d1-8fbc-4d5b-9e66-4b0d5aba4281 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:43.147340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0abce0d1-8fbc-4d5b-9e66-4b0d5aba4281 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:43.436308 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0abce0d1-8fbc-4d5b-9e66-4b0d5aba4281 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:43.449528 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0abce0d1-8fbc-4d5b-9e66-4b0d5aba4281 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1723 microversion: 2.1 time: 0.316728 May 12 14:43:43.451106 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 641/1265] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:43 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:44.469839 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ac359b29-101c-4c1a-9e8e-5c1fbe9a2d89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:44.470376 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ac359b29-101c-4c1a-9e8e-5c1fbe9a2d89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:44.477225 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ac359b29-101c-4c1a-9e8e-5c1fbe9a2d89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:44.477828 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ac359b29-101c-4c1a-9e8e-5c1fbe9a2d89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:44.478693 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ac359b29-101c-4c1a-9e8e-5c1fbe9a2d89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:44.479322 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ac359b29-101c-4c1a-9e8e-5c1fbe9a2d89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:44.707938 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ac359b29-101c-4c1a-9e8e-5c1fbe9a2d89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:44.717068 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ac359b29-101c-4c1a-9e8e-5c1fbe9a2d89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1723 microversion: 2.1 time: 0.254489 May 12 14:43:44.717782 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 625/1266] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:44 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:45.733925 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-90f4896e-b21d-4042-9cc3-d94bdc60df95 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:45.734445 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-90f4896e-b21d-4042-9cc3-d94bdc60df95 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:45.740711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-90f4896e-b21d-4042-9cc3-d94bdc60df95 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:45.741253 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-90f4896e-b21d-4042-9cc3-d94bdc60df95 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:45.742030 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-90f4896e-b21d-4042-9cc3-d94bdc60df95 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:45.742468 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-90f4896e-b21d-4042-9cc3-d94bdc60df95 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:45.877302 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-90f4896e-b21d-4042-9cc3-d94bdc60df95 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:45.885047 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-90f4896e-b21d-4042-9cc3-d94bdc60df95 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1723 microversion: 2.1 time: 0.155095 May 12 14:43:45.885641 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 642/1267] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:45 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:46.046489 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-60877934-ee3c-4f4b-ba93-a285b49d6782 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] Calling method '.version_select at 0x7f5b262601f0>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:46.092711 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-60877934-ee3c-4f4b-ba93-a285b49d6782 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/d401383f-3ce9-4179-aef6-86b618efceee" status: 200 len: 351 microversion: 2.1 time: 0.050522 May 12 14:43:46.093307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 626/1268] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 12 14:43:46 2022] GET /compute/v2.1/os-volumes/d401383f-3ce9-4179-aef6-86b618efceee => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:46.902486 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-245270ab-0c5c-444b-aab3-2c4b21334427 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:46.903127 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-245270ab-0c5c-444b-aab3-2c4b21334427 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:46.910203 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-245270ab-0c5c-444b-aab3-2c4b21334427 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:46.910658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-245270ab-0c5c-444b-aab3-2c4b21334427 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:46.911470 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-245270ab-0c5c-444b-aab3-2c4b21334427 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:46.911914 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-245270ab-0c5c-444b-aab3-2c4b21334427 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:47.037249 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-245270ab-0c5c-444b-aab3-2c4b21334427 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:47.044909 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-245270ab-0c5c-444b-aab3-2c4b21334427 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1723 microversion: 2.1 time: 0.146331 May 12 14:43:47.045477 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 643/1269] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:46 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:47.397643 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1c56ca49-d8f8-433e-bb5e-8874a595314e tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] Calling method '.version_select at 0x7f5b262e6550>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:47.443522 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1c56ca49-d8f8-433e-bb5e-8874a595314e tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/330d6ead-eeba-41b0-9b53-97eb4edff223" status: 200 len: 350 microversion: 2.1 time: 0.050083 May 12 14:43:47.444080 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 627/1270] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 12 14:43:47 2022] GET /compute/v2.1/os-volumes/330d6ead-eeba-41b0-9b53-97eb4edff223 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:48.061567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-be964ef3-80ce-41b0-aa97-6bda87872206 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:48.062864 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-be964ef3-80ce-41b0-aa97-6bda87872206 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:48.069349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-be964ef3-80ce-41b0-aa97-6bda87872206 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:48.069805 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-be964ef3-80ce-41b0-aa97-6bda87872206 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:48.070590 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-be964ef3-80ce-41b0-aa97-6bda87872206 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:48.071056 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-be964ef3-80ce-41b0-aa97-6bda87872206 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:48.203113 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-be964ef3-80ce-41b0-aa97-6bda87872206 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:48.211062 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-be964ef3-80ce-41b0-aa97-6bda87872206 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1723 microversion: 2.1 time: 0.153404 May 12 14:43:48.211672 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 644/1271] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:48 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:48.751612 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e3861726-96df-4f93-9181-525e891ccc36 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] Calling method '.version_select at 0x7f5b28e4bdc0>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:48.799549 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e3861726-96df-4f93-9181-525e891ccc36 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/b1b01bb1-683d-408c-a6e9-85b432ba5cb1" status: 200 len: 351 microversion: 2.1 time: 0.052612 May 12 14:43:48.800130 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 628/1272] 10.222.0.75 () {58 vars in 1244 bytes} [Thu May 12 14:43:48 2022] GET /compute/v2.1/os-volumes/b1b01bb1-683d-408c-a6e9-85b432ba5cb1 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:48.811786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9b38e87d-b9b2-4086-8c14-22ff005c8b52 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] Calling method '.version_select at 0x7f5b26a3d550>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:48.894534 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9b38e87d-b9b2-4086-8c14-22ff005c8b52 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086985 May 12 14:43:48.895235 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 645/1273] 10.222.0.75 () {58 vars in 1133 bytes} [Thu May 12 14:43:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:48.907147 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-84878383-3eaa-4243-9b56-f40b12ad8481 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] Calling method '.version_select at 0x7f5b262e6af0>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:48.990886 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-84878383-3eaa-4243-9b56-f40b12ad8481 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087494 May 12 14:43:48.991494 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 629/1274] 10.222.0.75 () {58 vars in 1148 bytes} [Thu May 12 14:43:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:49.004013 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c0a01112-ade8-420e-b151-5a4f01fc32e5 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] Calling method '.version_select at 0x7f5b26ae8820>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:49.081696 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c0a01112-ade8-420e-b151-5a4f01fc32e5 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.081495 May 12 14:43:49.082310 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 646/1275] 10.222.0.75 () {58 vars in 1133 bytes} [Thu May 12 14:43:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:49.093367 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ccd7d08a-9f34-4a24-876f-35a25c54c583 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] Calling method '.version_select at 0x7f5b26064310>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:49.180426 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ccd7d08a-9f34-4a24-876f-35a25c54c583 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090831 May 12 14:43:49.181211 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 630/1276] 10.222.0.75 () {58 vars in 1166 bytes} [Thu May 12 14:43:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:49.196384 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-fe1481a3-dec4-4976-a429-046a6e02b8b7 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] Calling method '.version_select at 0x7f5b26c6daf0>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:49.228976 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6d9b5b32-f374-42f8-b4ec-90fc0bc912fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:49.230022 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6d9b5b32-f374-42f8-b4ec-90fc0bc912fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:49.237361 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6d9b5b32-f374-42f8-b4ec-90fc0bc912fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:49.238469 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6d9b5b32-f374-42f8-b4ec-90fc0bc912fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:49.239648 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6d9b5b32-f374-42f8-b4ec-90fc0bc912fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:49.240287 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6d9b5b32-f374-42f8-b4ec-90fc0bc912fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:49.290092 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-fe1481a3-dec4-4976-a429-046a6e02b8b7 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.099825 May 12 14:43:49.290703 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 647/1277] 10.222.0.75 () {58 vars in 1169 bytes} [Thu May 12 14:43:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:49.302825 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7b503064-5ba2-4b01-b695-0b49c2d8ce90 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] Calling method '.version_select at 0x7f5b26a3dd30>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:49.380224 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-6d9b5b32-f374-42f8-b4ec-90fc0bc912fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:49.388121 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6d9b5b32-f374-42f8-b4ec-90fc0bc912fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1723 microversion: 2.1 time: 0.163393 May 12 14:43:49.388695 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 631/1278] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:49 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:43:49.390631 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7b503064-5ba2-4b01-b695-0b49c2d8ce90 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091496 May 12 14:43:49.395066 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 648/1279] 10.222.0.75 () {58 vars in 1154 bytes} [Thu May 12 14:43:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:43:49.401969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a4c72c0d-78c2-46c8-aae7-e3026aab1172 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] Calling method '.version_select at 0x7f5b26260820>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:49.479543 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a4c72c0d-78c2-46c8-aae7-e3026aab1172 tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.081116 May 12 14:43:49.480119 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 632/1280] 10.222.0.75 () {58 vars in 1187 bytes} [Thu May 12 14:43:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:49.492581 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-37f22dd4-8247-42ad-a6c0-548080942e6f tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] Calling method '.version_select at 0x7f5b26ae80d0>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:49.594682 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-37f22dd4-8247-42ad-a6c0-548080942e6f tempest-VolumesTestJSON-880269091 tempest-VolumesTestJSON-880269091-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.106206 May 12 14:43:49.595437 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 649/1281] 10.222.0.75 () {58 vars in 1154 bytes} [Thu May 12 14:43:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:50.405712 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b2eb94d3-5c78-4db2-833d-2d4d1ad05c18 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:50.406326 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b2eb94d3-5c78-4db2-833d-2d4d1ad05c18 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:50.413797 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b2eb94d3-5c78-4db2-833d-2d4d1ad05c18 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:50.413958 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b2eb94d3-5c78-4db2-833d-2d4d1ad05c18 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:50.414737 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b2eb94d3-5c78-4db2-833d-2d4d1ad05c18 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:50.415206 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b2eb94d3-5c78-4db2-833d-2d4d1ad05c18 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:50.546968 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-b2eb94d3-5c78-4db2-833d-2d4d1ad05c18 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:50.555112 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b2eb94d3-5c78-4db2-833d-2d4d1ad05c18 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1700 microversion: 2.1 time: 0.153566 May 12 14:43:50.555718 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 633/1282] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:50 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1700 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:50.574488 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-231ffc8d-6c28-4253-b911-05ba44893b08 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:43:50.581698 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-231ffc8d-6c28-4253-b911-05ba44893b08 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:50.582160 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-231ffc8d-6c28-4253-b911-05ba44893b08 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:50.604236 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-231ffc8d-6c28-4253-b911-05ba44893b08 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Going to try to start instance {{(pid=118217) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 14:43:50.650497 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-231ffc8d-6c28-4253-b911-05ba44893b08 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "POST /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/action" status: 202 len: 0 microversion: 2.1 time: 0.080103 May 12 14:43:50.654822 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 650/1283] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 12 14:43:50 2022] POST /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:43:50.661168 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7da68f78-cd77-47bd-b6a8-a9c3d251209f tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:50.661859 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7da68f78-cd77-47bd-b6a8-a9c3d251209f tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:50.668279 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7da68f78-cd77-47bd-b6a8-a9c3d251209f tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:50.668898 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7da68f78-cd77-47bd-b6a8-a9c3d251209f tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:50.669847 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7da68f78-cd77-47bd-b6a8-a9c3d251209f tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:50.670429 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7da68f78-cd77-47bd-b6a8-a9c3d251209f tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:50.830347 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7da68f78-cd77-47bd-b6a8-a9c3d251209f tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:50.838319 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7da68f78-cd77-47bd-b6a8-a9c3d251209f tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1709 microversion: 2.1 time: 0.180952 May 12 14:43:50.851272 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 634/1284] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:50 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1709 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:51.856709 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4b8a7268-5acf-42cb-97c4-d267c0ab0c09 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:51.857784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4b8a7268-5acf-42cb-97c4-d267c0ab0c09 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:51.865163 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4b8a7268-5acf-42cb-97c4-d267c0ab0c09 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:51.865752 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4b8a7268-5acf-42cb-97c4-d267c0ab0c09 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:51.866432 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4b8a7268-5acf-42cb-97c4-d267c0ab0c09 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:51.866879 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4b8a7268-5acf-42cb-97c4-d267c0ab0c09 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:52.018930 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4b8a7268-5acf-42cb-97c4-d267c0ab0c09 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:52.027004 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4b8a7268-5acf-42cb-97c4-d267c0ab0c09 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1709 microversion: 2.1 time: 0.175375 May 12 14:43:52.027618 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 651/1285] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:51 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1709 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:53.044867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-cb763426-d955-408a-9c82-a3b674b74a1b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:53.046163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-cb763426-d955-408a-9c82-a3b674b74a1b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:53.053374 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cb763426-d955-408a-9c82-a3b674b74a1b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:53.054091 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cb763426-d955-408a-9c82-a3b674b74a1b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:53.055513 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cb763426-d955-408a-9c82-a3b674b74a1b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:53.056656 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cb763426-d955-408a-9c82-a3b674b74a1b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:53.227967 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-cb763426-d955-408a-9c82-a3b674b74a1b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:53.242428 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-cb763426-d955-408a-9c82-a3b674b74a1b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1713 microversion: 2.1 time: 0.201999 May 12 14:43:53.243703 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 635/1286] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:53 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1713 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:53.323062 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9932d65c-5d28-414e-ae7d-8fa30b556b22 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:53.323603 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9932d65c-5d28-414e-ae7d-8fa30b556b22 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:53.331983 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-4d06e381-1b7d-4339-95fc-9918b3ed5b55 req-7b8c146b-f13a-4080-babc-38a0e1ac0b9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a93128f-bc24-4529-8b60-6d661e9933bf", "tag": "80f0b63a-177b-495c-b004-f7919b935f84"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:43:53.341324 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9932d65c-5d28-414e-ae7d-8fa30b556b22 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:53.341791 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9932d65c-5d28-414e-ae7d-8fa30b556b22 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:53.342617 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9932d65c-5d28-414e-ae7d-8fa30b556b22 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:53.343077 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9932d65c-5d28-414e-ae7d-8fa30b556b22 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:53.345307 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-4d06e381-1b7d-4339-95fc-9918b3ed5b55 req-7b8c146b-f13a-4080-babc-38a0e1ac0b9a service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:53.345942 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-4d06e381-1b7d-4339-95fc-9918b3ed5b55 req-7b8c146b-f13a-4080-babc-38a0e1ac0b9a service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:53.375902 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-4d06e381-1b7d-4339-95fc-9918b3ed5b55 req-7b8c146b-f13a-4080-babc-38a0e1ac0b9a service nova] Creating event network-changed:80f0b63a-177b-495c-b004-f7919b935f84 for instance 3a93128f-bc24-4529-8b60-6d661e9933bf on hv-cinder-77703 May 12 14:43:53.387529 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-4d06e381-1b7d-4339-95fc-9918b3ed5b55 req-7b8c146b-f13a-4080-babc-38a0e1ac0b9a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059043 May 12 14:43:53.388150 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 636/1287] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:43:53.393520 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9932d65c-5d28-414e-ae7d-8fa30b556b22 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Going to try to terminate instance {{(pid=118217) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:43:53.518040 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9932d65c-5d28-414e-ae7d-8fa30b556b22 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "DELETE /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 204 len: 0 microversion: 2.1 time: 0.198513 May 12 14:43:53.518826 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 652/1288] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:43:53 2022] DELETE /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:43:53.532876 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f4732dbd-deac-47d5-bba2-b181f55afcb1 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:53.535870 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f4732dbd-deac-47d5-bba2-b181f55afcb1 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:53.550878 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f4732dbd-deac-47d5-bba2-b181f55afcb1 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:53.551584 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f4732dbd-deac-47d5-bba2-b181f55afcb1 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:53.552576 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f4732dbd-deac-47d5-bba2-b181f55afcb1 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:53.553181 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f4732dbd-deac-47d5-bba2-b181f55afcb1 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:53.704638 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f4732dbd-deac-47d5-bba2-b181f55afcb1 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:53.715054 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f4732dbd-deac-47d5-bba2-b181f55afcb1 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1578 microversion: 2.1 time: 0.191931 May 12 14:43:53.716742 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 637/1289] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:53 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1578 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:54.734308 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-904ebcd1-f04c-4e68-800c-9bbcff08e396 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:54.734871 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-904ebcd1-f04c-4e68-800c-9bbcff08e396 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:54.741491 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-904ebcd1-f04c-4e68-800c-9bbcff08e396 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:54.741997 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-904ebcd1-f04c-4e68-800c-9bbcff08e396 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:54.742829 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-904ebcd1-f04c-4e68-800c-9bbcff08e396 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:54.743310 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-904ebcd1-f04c-4e68-800c-9bbcff08e396 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:54.985099 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-904ebcd1-f04c-4e68-800c-9bbcff08e396 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:54.992693 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-904ebcd1-f04c-4e68-800c-9bbcff08e396 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1578 microversion: 2.1 time: 0.262810 May 12 14:43:54.993278 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 653/1290] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:54 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1578 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:56.012090 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a8eca428-a1fe-4d41-a8b7-aca1d45bc778 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:56.012636 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a8eca428-a1fe-4d41-a8b7-aca1d45bc778 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:56.015845 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-a68fe30d-ccde-4141-8f50-afcc7056db58 req-40823334-bec2-4d20-80fc-5d9f36dc036d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a93128f-bc24-4529-8b60-6d661e9933bf", "name": "network-vif-deleted", "tag": "80f0b63a-177b-495c-b004-f7919b935f84"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:43:56.020454 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a8eca428-a1fe-4d41-a8b7-aca1d45bc778 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:56.020803 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a8eca428-a1fe-4d41-a8b7-aca1d45bc778 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:56.021651 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a8eca428-a1fe-4d41-a8b7-aca1d45bc778 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:56.022109 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a8eca428-a1fe-4d41-a8b7-aca1d45bc778 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:56.024628 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-a68fe30d-ccde-4141-8f50-afcc7056db58 req-40823334-bec2-4d20-80fc-5d9f36dc036d service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:56.024984 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-a68fe30d-ccde-4141-8f50-afcc7056db58 req-40823334-bec2-4d20-80fc-5d9f36dc036d service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:56.036219 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-a68fe30d-ccde-4141-8f50-afcc7056db58 req-40823334-bec2-4d20-80fc-5d9f36dc036d service nova] Creating event network-vif-deleted:80f0b63a-177b-495c-b004-f7919b935f84 for instance 3a93128f-bc24-4529-8b60-6d661e9933bf on hv-cinder-77703 May 12 14:43:56.040966 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-a68fe30d-ccde-4141-8f50-afcc7056db58 req-40823334-bec2-4d20-80fc-5d9f36dc036d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028815 May 12 14:43:56.041895 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 654/1291] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:43:56.089721 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a8eca428-a1fe-4d41-a8b7-aca1d45bc778 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:56.097352 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a8eca428-a1fe-4d41-a8b7-aca1d45bc778 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1392 microversion: 2.1 time: 0.090299 May 12 14:43:56.097935 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 638/1292] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:56 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1392 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:57.115382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f8162853-84fb-4726-8302-97c11f2e7ca8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:57.116110 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f8162853-84fb-4726-8302-97c11f2e7ca8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:57.122545 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f8162853-84fb-4726-8302-97c11f2e7ca8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:57.123003 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f8162853-84fb-4726-8302-97c11f2e7ca8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:57.124304 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f8162853-84fb-4726-8302-97c11f2e7ca8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:57.124776 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f8162853-84fb-4726-8302-97c11f2e7ca8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:57.187423 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f8162853-84fb-4726-8302-97c11f2e7ca8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:43:57.194958 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f8162853-84fb-4726-8302-97c11f2e7ca8 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 200 len: 1225 microversion: 2.1 time: 0.084219 May 12 14:43:57.195589 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 655/1293] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:57 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:43:58.214075 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-93857c7d-4f80-4370-b994-f47be946fbbe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:43:58.214696 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-93857c7d-4f80-4370-b994-f47be946fbbe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: 3a93128f-bc24-4529-8b60-6d661e9933bf] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:43:58.222871 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93857c7d-4f80-4370-b994-f47be946fbbe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:58.223354 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93857c7d-4f80-4370-b994-f47be946fbbe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:58.224259 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93857c7d-4f80-4370-b994-f47be946fbbe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:43:58.224985 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-93857c7d-4f80-4370-b994-f47be946fbbe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:43:58.240883 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-93857c7d-4f80-4370-b994-f47be946fbbe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] HTTP exception thrown: Instance 3a93128f-bc24-4529-8b60-6d661e9933bf could not be found. May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-93857c7d-4f80-4370-b994-f47be946fbbe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Request method failure captured: May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf HTTP/1.1 May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRqiHHLmmOHPj4maZnGsOi2nwns-851SXrvWGLlrvUXxrxFY3BZTuRQU_iFr0NA3QudzbzJC9YcjG6RkGlYiv9WUFskhxIEwaJNhweIFCcbkNOwgTopg3_BGXsuQbb5YkZd2MudSuKBy6CZqIwlUN6wzq_LSJcm6TpNFM-o0bCTHj7I May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 0ba0ea753bb0496cbf274e802f50dd0e May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-TestVolumeBootPattern-6195434 May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:43:58.242605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:43:58.244557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0ba0ea753bb0496cbf274e802f50dd0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0ba0ea753bb0496cbf274e802f50dd0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0ba0ea753bb0496cbf274e802f50dd0e", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0ba0ea753bb0496cbf274e802f50dd0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:43:58.244557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-TestVolumeBootPattern-6195434 May 12 14:43:58.244557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 0ba0ea753bb0496cbf274e802f50dd0e May 12 14:43:58.244557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-TestVolumeBootPattern-6195434 May 12 14:43:58.244557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-TestVolumeBootPattern-6195434-project May 12 14:43:58.244557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:43:58.244557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:43:58.244557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: a64c3ea69151401897e4203095676543 May 12 14:43:58.244557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-TestVolumeBootPattern-6195434-project May 12 14:43:58.244557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:43:58.244557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance 3a93128f-bc24-4529-8b60-6d661e9933bf could not be found. May 12 14:43:58.244557 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '3a93128f-bc24-4529-8b60-6d661e9933bf'} May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a93128f-bc24-4529-8b60-6d661e9933bf could not be found. May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:43:58.245573 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a93128f-bc24-4529-8b60-6d661e9933bf could not be found. May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a93128f-bc24-4529-8b60-6d661e9933bf could not be found. May 12 14:43:58.246874 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:43:58.248036 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-93857c7d-4f80-4370-b994-f47be946fbbe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Returning 404 to user: Instance 3a93128f-bc24-4529-8b60-6d661e9933bf could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:43:58.248036 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-93857c7d-4f80-4370-b994-f47be946fbbe tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf" status: 404 len: 111 microversion: 2.1 time: 0.033964 May 12 14:43:58.248036 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 639/1294] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:43:58 2022] GET /compute/v2.1/servers/3a93128f-bc24-4529-8b60-6d661e9933bf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:44:01.922539 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-68bfffed-da7d-4ede-bb12-7b3b9b0ab390 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:01.923828 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-68bfffed-da7d-4ede-bb12-7b3b9b0ab390 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:01.925300 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-1fedeabf-e018-42bf-959f-f7b95d486c9d req-d5806069-7875-4b8f-a137-76b6a9bbb9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c45819a2-89a0-494b-bdbc-650fcfddd2cd", "tag": "10ba03ca-52fe-42dc-a95e-573a96e2bd48"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:01.931422 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-68bfffed-da7d-4ede-bb12-7b3b9b0ab390 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:01.932210 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-68bfffed-da7d-4ede-bb12-7b3b9b0ab390 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:01.933228 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-68bfffed-da7d-4ede-bb12-7b3b9b0ab390 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:01.933860 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-68bfffed-da7d-4ede-bb12-7b3b9b0ab390 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:01.939317 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-1fedeabf-e018-42bf-959f-f7b95d486c9d req-d5806069-7875-4b8f-a137-76b6a9bbb9d4 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:01.940034 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-1fedeabf-e018-42bf-959f-f7b95d486c9d req-d5806069-7875-4b8f-a137-76b6a9bbb9d4 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:01.953121 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-1fedeabf-e018-42bf-959f-f7b95d486c9d req-d5806069-7875-4b8f-a137-76b6a9bbb9d4 service nova] Creating event network-changed:10ba03ca-52fe-42dc-a95e-573a96e2bd48 for instance c45819a2-89a0-494b-bdbc-650fcfddd2cd on hv-cinder-77703 May 12 14:44:01.961679 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-1fedeabf-e018-42bf-959f-f7b95d486c9d req-d5806069-7875-4b8f-a137-76b6a9bbb9d4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041833 May 12 14:44:01.963312 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 640/1295] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:44:01.972149 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-68bfffed-da7d-4ede-bb12-7b3b9b0ab390 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Going to try to terminate instance {{(pid=118217) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:44:02.097665 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-68bfffed-da7d-4ede-bb12-7b3b9b0ab390 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 204 len: 0 microversion: 2.1 time: 0.179714 May 12 14:44:02.103386 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 656/1296] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:44:01 2022] DELETE /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:44:02.113262 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e11c83a4-bb30-420a-80a8-1a89f5336e0d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:02.113970 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e11c83a4-bb30-420a-80a8-1a89f5336e0d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:02.124076 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e11c83a4-bb30-420a-80a8-1a89f5336e0d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:02.125073 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e11c83a4-bb30-420a-80a8-1a89f5336e0d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:02.126020 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e11c83a4-bb30-420a-80a8-1a89f5336e0d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:02.126714 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e11c83a4-bb30-420a-80a8-1a89f5336e0d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:02.346675 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e11c83a4-bb30-420a-80a8-1a89f5336e0d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:02.362218 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e11c83a4-bb30-420a-80a8-1a89f5336e0d tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1577 microversion: 2.1 time: 0.254009 May 12 14:44:02.362809 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 641/1297] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:02 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1577 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:03.383711 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-ed92088f-eb73-4d48-9526-a2e52a0031f2 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:03.384429 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-ed92088f-eb73-4d48-9526-a2e52a0031f2 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:03.394474 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ed92088f-eb73-4d48-9526-a2e52a0031f2 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:03.395149 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ed92088f-eb73-4d48-9526-a2e52a0031f2 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:03.396126 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ed92088f-eb73-4d48-9526-a2e52a0031f2 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:03.396739 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-ed92088f-eb73-4d48-9526-a2e52a0031f2 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:03.634847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-ed92088f-eb73-4d48-9526-a2e52a0031f2 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64c3ea69151401897e4203095676543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ea753bb0496cbf274e802f50dd0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:03.646558 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-ed92088f-eb73-4d48-9526-a2e52a0031f2 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 200 len: 1459 microversion: 2.1 time: 0.268009 May 12 14:44:03.647742 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 657/1298] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:03 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 1459 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:03.978100 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-3c475166-dd40-40f9-a6e0-29a6f1100643 req-bb0305e4-cd70-40ce-a4e4-bc3a1008e4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45819a2-89a0-494b-bdbc-650fcfddd2cd", "name": "network-vif-deleted", "tag": "10ba03ca-52fe-42dc-a95e-573a96e2bd48"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:03.991416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-3c475166-dd40-40f9-a6e0-29a6f1100643 req-bb0305e4-cd70-40ce-a4e4-bc3a1008e4a3 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:03.992123 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-3c475166-dd40-40f9-a6e0-29a6f1100643 req-bb0305e4-cd70-40ce-a4e4-bc3a1008e4a3 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:04.006186 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-3c475166-dd40-40f9-a6e0-29a6f1100643 req-bb0305e4-cd70-40ce-a4e4-bc3a1008e4a3 service nova] Creating event network-vif-deleted:10ba03ca-52fe-42dc-a95e-573a96e2bd48 for instance c45819a2-89a0-494b-bdbc-650fcfddd2cd on hv-cinder-77703 May 12 14:44:04.012157 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-3c475166-dd40-40f9-a6e0-29a6f1100643 req-bb0305e4-cd70-40ce-a4e4-bc3a1008e4a3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037551 May 12 14:44:04.012844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 642/1299] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:44:04.665606 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bfa5cfc6-8e96-4e88-bfeb-e5bf4eb2ac72 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:04.666236 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bfa5cfc6-8e96-4e88-bfeb-e5bf4eb2ac72 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: c45819a2-89a0-494b-bdbc-650fcfddd2cd] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:04.672514 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bfa5cfc6-8e96-4e88-bfeb-e5bf4eb2ac72 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:04.672975 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bfa5cfc6-8e96-4e88-bfeb-e5bf4eb2ac72 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:04.673756 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bfa5cfc6-8e96-4e88-bfeb-e5bf4eb2ac72 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:04.674197 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bfa5cfc6-8e96-4e88-bfeb-e5bf4eb2ac72 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:04.689063 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-bfa5cfc6-8e96-4e88-bfeb-e5bf4eb2ac72 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] HTTP exception thrown: Instance c45819a2-89a0-494b-bdbc-650fcfddd2cd could not be found. May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bfa5cfc6-8e96-4e88-bfeb-e5bf4eb2ac72 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Request method failure captured: May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd HTTP/1.1 May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRqiHHLmmOHPj4maZnGsOi2nwns-851SXrvWGLlrvUXxrxFY3BZTuRQU_iFr0NA3QudzbzJC9YcjG6RkGlYiv9WUFskhxIEwaJNhweIFCcbkNOwgTopg3_BGXsuQbb5YkZd2MudSuKBy6CZqIwlUN6wzq_LSJcm6TpNFM-o0bCTHj7I May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 0ba0ea753bb0496cbf274e802f50dd0e May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-TestVolumeBootPattern-6195434 May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:44:04.691319 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:44:04.692999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0ba0ea753bb0496cbf274e802f50dd0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0ba0ea753bb0496cbf274e802f50dd0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0ba0ea753bb0496cbf274e802f50dd0e", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0ba0ea753bb0496cbf274e802f50dd0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:44:04.692999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-TestVolumeBootPattern-6195434 May 12 14:44:04.692999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 0ba0ea753bb0496cbf274e802f50dd0e May 12 14:44:04.692999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-TestVolumeBootPattern-6195434 May 12 14:44:04.692999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-TestVolumeBootPattern-6195434-project May 12 14:44:04.692999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:44:04.692999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:44:04.692999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: a64c3ea69151401897e4203095676543 May 12 14:44:04.692999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-TestVolumeBootPattern-6195434-project May 12 14:44:04.692999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:44:04.692999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance c45819a2-89a0-494b-bdbc-650fcfddd2cd could not be found. May 12 14:44:04.692999 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': 'c45819a2-89a0-494b-bdbc-650fcfddd2cd'} May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c45819a2-89a0-494b-bdbc-650fcfddd2cd could not be found. May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:44:04.693953 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c45819a2-89a0-494b-bdbc-650fcfddd2cd could not be found. May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c45819a2-89a0-494b-bdbc-650fcfddd2cd could not be found. May 12 14:44:04.695567 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:44:04.697952 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bfa5cfc6-8e96-4e88-bfeb-e5bf4eb2ac72 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Returning 404 to user: Instance c45819a2-89a0-494b-bdbc-650fcfddd2cd could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:44:04.698991 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bfa5cfc6-8e96-4e88-bfeb-e5bf4eb2ac72 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd" status: 404 len: 111 microversion: 2.1 time: 0.038305 May 12 14:44:04.699585 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 658/1300] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:04 2022] GET /compute/v2.1/servers/c45819a2-89a0-494b-bdbc-650fcfddd2cd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:44:05.180284 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6a074f51-5e34-40d6-8fb6-1ab265c2f4b6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:05.180871 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-6a074f51-5e34-40d6-8fb6-1ab265c2f4b6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:05.187586 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6a074f51-5e34-40d6-8fb6-1ab265c2f4b6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:05.188038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6a074f51-5e34-40d6-8fb6-1ab265c2f4b6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:05.188817 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6a074f51-5e34-40d6-8fb6-1ab265c2f4b6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:05.189256 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-6a074f51-5e34-40d6-8fb6-1ab265c2f4b6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:05.202062 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-6a074f51-5e34-40d6-8fb6-1ab265c2f4b6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] HTTP exception thrown: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6a074f51-5e34-40d6-8fb6-1ab265c2f4b6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Request method failure captured: May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: DELETE /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 HTTP/1.1 May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRqiHHLmmOHPj4maZnGsOi2nwns-851SXrvWGLlrvUXxrxFY3BZTuRQU_iFr0NA3QudzbzJC9YcjG6RkGlYiv9WUFskhxIEwaJNhweIFCcbkNOwgTopg3_BGXsuQbb5YkZd2MudSuKBy6CZqIwlUN6wzq_LSJcm6TpNFM-o0bCTHj7I May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 0ba0ea753bb0496cbf274e802f50dd0e May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-TestVolumeBootPattern-6195434 May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:44:05.203744 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:44:05.205416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0ba0ea753bb0496cbf274e802f50dd0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0ba0ea753bb0496cbf274e802f50dd0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0ba0ea753bb0496cbf274e802f50dd0e", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0ba0ea753bb0496cbf274e802f50dd0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:44:05.205416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-TestVolumeBootPattern-6195434 May 12 14:44:05.205416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 0ba0ea753bb0496cbf274e802f50dd0e May 12 14:44:05.205416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-TestVolumeBootPattern-6195434 May 12 14:44:05.205416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-TestVolumeBootPattern-6195434-project May 12 14:44:05.205416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:44:05.205416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:44:05.205416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: a64c3ea69151401897e4203095676543 May 12 14:44:05.205416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-TestVolumeBootPattern-6195434-project May 12 14:44:05.205416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:44:05.205416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. May 12 14:44:05.205416 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': 'b53d1801-00ff-4886-8632-1d02c3275dd5'} May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:44:05.210106 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. May 12 14:44:05.211875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:44:05.213362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-6a074f51-5e34-40d6-8fb6-1ab265c2f4b6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Returning 404 to user: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:44:05.213362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-6a074f51-5e34-40d6-8fb6-1ab265c2f4b6 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 404 len: 111 microversion: 2.1 time: 0.029267 May 12 14:44:05.213362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 643/1301] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:44:05 2022] DELETE /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:44:05.213899 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d07df727-93ce-4c25-b2bf-b2a4da7a4cd7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:05.214524 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d07df727-93ce-4c25-b2bf-b2a4da7a4cd7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] [instance: b53d1801-00ff-4886-8632-1d02c3275dd5] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:05.220764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d07df727-93ce-4c25-b2bf-b2a4da7a4cd7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:05.221221 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d07df727-93ce-4c25-b2bf-b2a4da7a4cd7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:05.222004 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d07df727-93ce-4c25-b2bf-b2a4da7a4cd7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:05.222464 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d07df727-93ce-4c25-b2bf-b2a4da7a4cd7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:05.236325 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-d07df727-93ce-4c25-b2bf-b2a4da7a4cd7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] HTTP exception thrown: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d07df727-93ce-4c25-b2bf-b2a4da7a4cd7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Request method failure captured: May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 HTTP/1.1 May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRqiHHLmmOHPj4maZnGsOi2nwns-851SXrvWGLlrvUXxrxFY3BZTuRQU_iFr0NA3QudzbzJC9YcjG6RkGlYiv9WUFskhxIEwaJNhweIFCcbkNOwgTopg3_BGXsuQbb5YkZd2MudSuKBy6CZqIwlUN6wzq_LSJcm6TpNFM-o0bCTHj7I May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 0ba0ea753bb0496cbf274e802f50dd0e May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-TestVolumeBootPattern-6195434 May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:44:05.237847 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:44:05.239286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0ba0ea753bb0496cbf274e802f50dd0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0ba0ea753bb0496cbf274e802f50dd0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0ba0ea753bb0496cbf274e802f50dd0e", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0ba0ea753bb0496cbf274e802f50dd0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:44:05.239286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-TestVolumeBootPattern-6195434 May 12 14:44:05.239286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 0ba0ea753bb0496cbf274e802f50dd0e May 12 14:44:05.239286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-TestVolumeBootPattern-6195434 May 12 14:44:05.239286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-TestVolumeBootPattern-6195434-project May 12 14:44:05.239286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:44:05.239286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:44:05.239286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: a64c3ea69151401897e4203095676543 May 12 14:44:05.239286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-TestVolumeBootPattern-6195434-project May 12 14:44:05.239286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:44:05.239286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. May 12 14:44:05.239286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': 'b53d1801-00ff-4886-8632-1d02c3275dd5'} May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:44:05.240088 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. May 12 14:44:05.241663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:44:05.243012 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d07df727-93ce-4c25-b2bf-b2a4da7a4cd7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Returning 404 to user: Instance b53d1801-00ff-4886-8632-1d02c3275dd5 could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:44:05.243012 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d07df727-93ce-4c25-b2bf-b2a4da7a4cd7 tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5" status: 404 len: 111 microversion: 2.1 time: 0.029105 May 12 14:44:05.243012 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 659/1302] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:05 2022] GET /compute/v2.1/servers/b53d1801-00ff-4886-8632-1d02c3275dd5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:44:06.535436 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-cd7b1739-855b-4436-8a3d-6374cb7c2b1a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] Calling method '.version_select at 0x7f5b262e6f70>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:06.570763 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-cd7b1739-855b-4436-8a3d-6374cb7c2b1a tempest-TestVolumeBootPattern-6195434 tempest-TestVolumeBootPattern-6195434-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-349363195" status: 202 len: 0 microversion: 2.1 time: 0.039138 May 12 14:44:06.571389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 644/1303] 10.222.0.75 () {58 vars in 1259 bytes} [Thu May 12 14:44:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-349363195 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:44:16.980426 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1056328233", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "networks": [{"uuid": "5477df79-3f77-4d26-bd44-a92ad32664f4"}]}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:17.038691 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.network.neutron [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] validate_networks() for [('5477df79-3f77-4d26-bd44-a92ad32664f4', None, None, None, None, None)] {{(pid=118217) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:44:17.471585 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Flavor limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:44:17.472007 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Image limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:44:17.472484 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Flavor pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:44:17.472894 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Image pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:44:17.473305 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:44:17.481842 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:17.482289 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:17.483113 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:17.483552 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:17.500038 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Getting quotas for project acae066a447040f98bf289109ed61c77. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:44:17.503883 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Getting quotas for user 426f0c09f59941b195964297fd3dc6b4 and project acae066a447040f98bf289109ed61c77. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:44:17.515094 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Going to run 1 instances... {{(pid=118217) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:44:17.517287 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:44:17.563251 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1e11304f-df1f-438a-b7f1-37ca4ca6fc31 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586755 May 12 14:44:17.563896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 660/1304] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:44:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:44:17.574247 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c43fac50-8c56-41aa-8001-6f7d83fad292 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:17.574859 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c43fac50-8c56-41aa-8001-6f7d83fad292 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:17.631578 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c43fac50-8c56-41aa-8001-6f7d83fad292 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:17.638078 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c43fac50-8c56-41aa-8001-6f7d83fad292 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1214 microversion: 2.1 time: 0.068259 May 12 14:44:17.638686 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 645/1305] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:17 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:18.656575 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0bd9ea14-167e-4b49-9282-d74831e5a6cb tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:18.657301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0bd9ea14-167e-4b49-9282-d74831e5a6cb tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:18.665030 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0bd9ea14-167e-4b49-9282-d74831e5a6cb tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:18.665998 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0bd9ea14-167e-4b49-9282-d74831e5a6cb tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:18.666790 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0bd9ea14-167e-4b49-9282-d74831e5a6cb tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:18.667269 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0bd9ea14-167e-4b49-9282-d74831e5a6cb tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:18.745045 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0bd9ea14-167e-4b49-9282-d74831e5a6cb tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:18.756698 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0bd9ea14-167e-4b49-9282-d74831e5a6cb tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1274 microversion: 2.1 time: 0.105139 May 12 14:44:18.761492 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 661/1306] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:18 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:19.775963 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-9f6bbc52-18e2-4c4d-aaa1-264a65da991b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:19.776748 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-9f6bbc52-18e2-4c4d-aaa1-264a65da991b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:19.783653 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f6bbc52-18e2-4c4d-aaa1-264a65da991b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:19.784111 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f6bbc52-18e2-4c4d-aaa1-264a65da991b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:19.784894 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f6bbc52-18e2-4c4d-aaa1-264a65da991b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:19.785373 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-9f6bbc52-18e2-4c4d-aaa1-264a65da991b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:19.999768 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-9f6bbc52-18e2-4c4d-aaa1-264a65da991b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:20.008422 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-9f6bbc52-18e2-4c4d-aaa1-264a65da991b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1314 microversion: 2.1 time: 0.236140 May 12 14:44:20.009124 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 646/1307] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:19 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:20.123256 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-c775eeac-3ed3-4ceb-af97-8c5d47779c61 req-e1b20e8d-ca64-4261-8573-60d27db04968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b32f74-bb67-4c09-93a7-f25bdd84e216", "tag": "0d25dd6c-3d83-43fe-963a-edc06fcb5bf8"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:20.131892 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-c775eeac-3ed3-4ceb-af97-8c5d47779c61 req-e1b20e8d-ca64-4261-8573-60d27db04968 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:20.132628 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-c775eeac-3ed3-4ceb-af97-8c5d47779c61 req-e1b20e8d-ca64-4261-8573-60d27db04968 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:20.144772 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-c775eeac-3ed3-4ceb-af97-8c5d47779c61 req-e1b20e8d-ca64-4261-8573-60d27db04968 service nova] Creating event network-changed:0d25dd6c-3d83-43fe-963a-edc06fcb5bf8 for instance 32b32f74-bb67-4c09-93a7-f25bdd84e216 on hv-cinder-77703 May 12 14:44:20.149764 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-c775eeac-3ed3-4ceb-af97-8c5d47779c61 req-e1b20e8d-ca64-4261-8573-60d27db04968 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030495 May 12 14:44:20.150367 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 662/1308] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:44:21.025741 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-609d8554-ec63-410c-bbfc-954676acba4b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:21.026633 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-609d8554-ec63-410c-bbfc-954676acba4b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:21.033601 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-609d8554-ec63-410c-bbfc-954676acba4b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:21.034134 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-609d8554-ec63-410c-bbfc-954676acba4b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:21.034985 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-609d8554-ec63-410c-bbfc-954676acba4b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:21.035660 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-609d8554-ec63-410c-bbfc-954676acba4b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:21.169245 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-609d8554-ec63-410c-bbfc-954676acba4b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:21.178608 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-609d8554-ec63-410c-bbfc-954676acba4b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1314 microversion: 2.1 time: 0.156746 May 12 14:44:21.179296 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 647/1309] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:21 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:22.196622 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a587dc4c-8e2c-430c-86c8-8dd07fe81fa2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:22.197252 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a587dc4c-8e2c-430c-86c8-8dd07fe81fa2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:22.203318 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a587dc4c-8e2c-430c-86c8-8dd07fe81fa2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:22.203775 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a587dc4c-8e2c-430c-86c8-8dd07fe81fa2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:22.204546 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a587dc4c-8e2c-430c-86c8-8dd07fe81fa2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:22.204991 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a587dc4c-8e2c-430c-86c8-8dd07fe81fa2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:22.338934 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-a587dc4c-8e2c-430c-86c8-8dd07fe81fa2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:22.346769 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a587dc4c-8e2c-430c-86c8-8dd07fe81fa2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1314 microversion: 2.1 time: 0.154946 May 12 14:44:22.347403 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 663/1310] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:22 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:23.366956 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3ce573b3-0ecd-4dad-8a94-a42466c2844b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:23.367612 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3ce573b3-0ecd-4dad-8a94-a42466c2844b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:23.374574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3ce573b3-0ecd-4dad-8a94-a42466c2844b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:23.375124 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3ce573b3-0ecd-4dad-8a94-a42466c2844b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:23.376031 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3ce573b3-0ecd-4dad-8a94-a42466c2844b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:23.376593 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3ce573b3-0ecd-4dad-8a94-a42466c2844b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:23.507707 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3ce573b3-0ecd-4dad-8a94-a42466c2844b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:23.515401 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3ce573b3-0ecd-4dad-8a94-a42466c2844b tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1314 microversion: 2.1 time: 0.154731 May 12 14:44:23.515971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 648/1311] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:23 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:24.532091 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c6874436-533e-4c1c-a8db-cebc7255f474 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:24.532639 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c6874436-533e-4c1c-a8db-cebc7255f474 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:24.539018 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c6874436-533e-4c1c-a8db-cebc7255f474 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:24.539509 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c6874436-533e-4c1c-a8db-cebc7255f474 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:24.540292 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c6874436-533e-4c1c-a8db-cebc7255f474 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:24.540736 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c6874436-533e-4c1c-a8db-cebc7255f474 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:24.664964 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c6874436-533e-4c1c-a8db-cebc7255f474 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:24.672813 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c6874436-533e-4c1c-a8db-cebc7255f474 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1314 microversion: 2.1 time: 0.144711 May 12 14:44:24.673384 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 664/1312] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:24 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:25.689512 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-dbb3f971-731b-48c6-a56a-9cf2a7c71cef tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:25.690129 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-dbb3f971-731b-48c6-a56a-9cf2a7c71cef tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:25.696358 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dbb3f971-731b-48c6-a56a-9cf2a7c71cef tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:25.696814 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dbb3f971-731b-48c6-a56a-9cf2a7c71cef tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:25.697576 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dbb3f971-731b-48c6-a56a-9cf2a7c71cef tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:25.698014 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-dbb3f971-731b-48c6-a56a-9cf2a7c71cef tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:25.834120 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-dbb3f971-731b-48c6-a56a-9cf2a7c71cef tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:25.841518 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-dbb3f971-731b-48c6-a56a-9cf2a7c71cef tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1314 microversion: 2.1 time: 0.156300 May 12 14:44:25.842163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 649/1313] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:25 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:26.858799 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-7a4b0297-c8b4-43f7-9ff4-8c4289cfc6d2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:26.859509 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-7a4b0297-c8b4-43f7-9ff4-8c4289cfc6d2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:26.866154 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7a4b0297-c8b4-43f7-9ff4-8c4289cfc6d2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:26.866607 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7a4b0297-c8b4-43f7-9ff4-8c4289cfc6d2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:26.867440 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7a4b0297-c8b4-43f7-9ff4-8c4289cfc6d2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:26.867884 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-7a4b0297-c8b4-43f7-9ff4-8c4289cfc6d2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:26.997008 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-7a4b0297-c8b4-43f7-9ff4-8c4289cfc6d2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:27.004987 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-7a4b0297-c8b4-43f7-9ff4-8c4289cfc6d2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1314 microversion: 2.1 time: 0.150559 May 12 14:44:27.005566 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 665/1314] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:26 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:28.021757 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-09c0be09-1230-4dc4-abf3-731f6792b4c8 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:28.022411 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-09c0be09-1230-4dc4-abf3-731f6792b4c8 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:28.028689 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-09c0be09-1230-4dc4-abf3-731f6792b4c8 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:28.029153 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-09c0be09-1230-4dc4-abf3-731f6792b4c8 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:28.030297 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-09c0be09-1230-4dc4-abf3-731f6792b4c8 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:28.030742 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-09c0be09-1230-4dc4-abf3-731f6792b4c8 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:28.165691 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-09c0be09-1230-4dc4-abf3-731f6792b4c8 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:28.173917 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-09c0be09-1230-4dc4-abf3-731f6792b4c8 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1314 microversion: 2.1 time: 0.156071 May 12 14:44:28.183179 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 650/1315] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:28 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:29.190989 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-84647d17-5e0e-4333-bf93-59ada0485906 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:29.191751 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-84647d17-5e0e-4333-bf93-59ada0485906 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:29.198482 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-84647d17-5e0e-4333-bf93-59ada0485906 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:29.198966 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-84647d17-5e0e-4333-bf93-59ada0485906 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:29.199900 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-84647d17-5e0e-4333-bf93-59ada0485906 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:29.200425 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-84647d17-5e0e-4333-bf93-59ada0485906 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:29.331142 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-84647d17-5e0e-4333-bf93-59ada0485906 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:29.338854 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-84647d17-5e0e-4333-bf93-59ada0485906 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1314 microversion: 2.1 time: 0.151818 May 12 14:44:29.339476 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 666/1316] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:29 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:29.478342 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-9039c31e-f18c-4a73-8e57-94362249b975 req-c22f9e30-cf32-45b9-a8df-2ed718c83bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b32f74-bb67-4c09-93a7-f25bdd84e216", "name": "network-vif-plugged", "status": "completed", "tag": "0d25dd6c-3d83-43fe-963a-edc06fcb5bf8"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:29.486422 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-9039c31e-f18c-4a73-8e57-94362249b975 req-c22f9e30-cf32-45b9-a8df-2ed718c83bf1 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:29.486815 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-9039c31e-f18c-4a73-8e57-94362249b975 req-c22f9e30-cf32-45b9-a8df-2ed718c83bf1 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:29.498896 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-9039c31e-f18c-4a73-8e57-94362249b975 req-c22f9e30-cf32-45b9-a8df-2ed718c83bf1 service nova] Creating event network-vif-plugged:0d25dd6c-3d83-43fe-963a-edc06fcb5bf8 for instance 32b32f74-bb67-4c09-93a7-f25bdd84e216 on hv-cinder-77703 May 12 14:44:29.504203 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-9039c31e-f18c-4a73-8e57-94362249b975 req-c22f9e30-cf32-45b9-a8df-2ed718c83bf1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153679 May 12 14:44:29.504882 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 651/1317] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:44:30.356076 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-0836984e-927f-4dff-a9f9-074a983da1b2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:30.356694 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-0836984e-927f-4dff-a9f9-074a983da1b2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:30.362958 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0836984e-927f-4dff-a9f9-074a983da1b2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:30.363454 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0836984e-927f-4dff-a9f9-074a983da1b2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:30.364222 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0836984e-927f-4dff-a9f9-074a983da1b2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:30.364663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-0836984e-927f-4dff-a9f9-074a983da1b2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:30.490383 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-0836984e-927f-4dff-a9f9-074a983da1b2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:30.497866 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-0836984e-927f-4dff-a9f9-074a983da1b2 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1314 microversion: 2.1 time: 0.145780 May 12 14:44:30.498476 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 667/1318] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:30 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:31.515956 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-5f30e333-9458-4a04-ae74-10ab66686c28 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:31.516569 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-5f30e333-9458-4a04-ae74-10ab66686c28 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:31.522721 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5f30e333-9458-4a04-ae74-10ab66686c28 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:31.523212 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5f30e333-9458-4a04-ae74-10ab66686c28 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:31.523988 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5f30e333-9458-4a04-ae74-10ab66686c28 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:31.524430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5f30e333-9458-4a04-ae74-10ab66686c28 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:31.650304 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-5f30e333-9458-4a04-ae74-10ab66686c28 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:31.658011 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-5f30e333-9458-4a04-ae74-10ab66686c28 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1498 microversion: 2.1 time: 0.146971 May 12 14:44:31.658607 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 652/1319] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:31 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:32.138664 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bb4e77d6-198c-4b8e-96ea-a360dbbc9e1a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:32.139692 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bb4e77d6-198c-4b8e-96ea-a360dbbc9e1a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:32.145938 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bb4e77d6-198c-4b8e-96ea-a360dbbc9e1a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:32.146385 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bb4e77d6-198c-4b8e-96ea-a360dbbc9e1a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:32.147304 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bb4e77d6-198c-4b8e-96ea-a360dbbc9e1a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:32.147742 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bb4e77d6-198c-4b8e-96ea-a360dbbc9e1a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:32.172160 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bb4e77d6-198c-4b8e-96ea-a360dbbc9e1a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Going to try to terminate instance {{(pid=118217) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:44:32.249513 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bb4e77d6-198c-4b8e-96ea-a360dbbc9e1a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "DELETE /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 204 len: 0 microversion: 2.1 time: 0.113836 May 12 14:44:32.250079 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 668/1320] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:44:32 2022] DELETE /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:44:32.258523 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-a687ca6f-0a8b-478a-b0ad-ae8071bf975c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:32.259189 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-a687ca6f-0a8b-478a-b0ad-ae8071bf975c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:32.265682 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a687ca6f-0a8b-478a-b0ad-ae8071bf975c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:32.266133 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a687ca6f-0a8b-478a-b0ad-ae8071bf975c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:32.266908 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a687ca6f-0a8b-478a-b0ad-ae8071bf975c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:32.267409 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-a687ca6f-0a8b-478a-b0ad-ae8071bf975c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:32.391269 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-a687ca6f-0a8b-478a-b0ad-ae8071bf975c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:32.398497 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-a687ca6f-0a8b-478a-b0ad-ae8071bf975c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1504 microversion: 2.1 time: 0.144201 May 12 14:44:32.399089 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 653/1321] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:32 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1504 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:33.416454 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-29e9e14e-56c6-4132-940c-2a72b0eb11be tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:33.417163 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-29e9e14e-56c6-4132-940c-2a72b0eb11be tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:33.424052 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-29e9e14e-56c6-4132-940c-2a72b0eb11be tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:33.424515 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-29e9e14e-56c6-4132-940c-2a72b0eb11be tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:33.425288 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-29e9e14e-56c6-4132-940c-2a72b0eb11be tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:33.425732 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-29e9e14e-56c6-4132-940c-2a72b0eb11be tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:33.556105 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-29e9e14e-56c6-4132-940c-2a72b0eb11be tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:33.564334 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-29e9e14e-56c6-4132-940c-2a72b0eb11be tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1504 microversion: 2.1 time: 0.152124 May 12 14:44:33.564902 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 669/1322] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:33 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:34.581763 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-36d4cf24-00bd-46c8-b0fe-c6f32717b728 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:34.582380 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-36d4cf24-00bd-46c8-b0fe-c6f32717b728 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:34.588611 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-36d4cf24-00bd-46c8-b0fe-c6f32717b728 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:34.589054 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-36d4cf24-00bd-46c8-b0fe-c6f32717b728 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:34.589819 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-36d4cf24-00bd-46c8-b0fe-c6f32717b728 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:34.590263 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-36d4cf24-00bd-46c8-b0fe-c6f32717b728 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:34.766164 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-36d4cf24-00bd-46c8-b0fe-c6f32717b728 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:34.773707 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-36d4cf24-00bd-46c8-b0fe-c6f32717b728 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 200 len: 1504 microversion: 2.1 time: 0.195793 May 12 14:44:34.774293 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 654/1323] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:34 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:34.883264 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-4ef84f37-6f24-45b7-8244-b62c0d1bb8d5 req-cd1e99f9-a0d1-41d8-9319-c548d2b17223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b32f74-bb67-4c09-93a7-f25bdd84e216", "name": "network-vif-deleted", "tag": "0d25dd6c-3d83-43fe-963a-edc06fcb5bf8"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:34.891745 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-4ef84f37-6f24-45b7-8244-b62c0d1bb8d5 req-cd1e99f9-a0d1-41d8-9319-c548d2b17223 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:34.892450 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-4ef84f37-6f24-45b7-8244-b62c0d1bb8d5 req-cd1e99f9-a0d1-41d8-9319-c548d2b17223 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:34.903349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-4ef84f37-6f24-45b7-8244-b62c0d1bb8d5 req-cd1e99f9-a0d1-41d8-9319-c548d2b17223 service nova] Creating event network-vif-deleted:0d25dd6c-3d83-43fe-963a-edc06fcb5bf8 for instance 32b32f74-bb67-4c09-93a7-f25bdd84e216 on hv-cinder-77703 May 12 14:44:34.908150 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-4ef84f37-6f24-45b7-8244-b62c0d1bb8d5 req-cd1e99f9-a0d1-41d8-9319-c548d2b17223 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028844 May 12 14:44:34.908748 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 670/1324] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:44:35.791888 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-aa2685de-26ef-4f9b-8ce6-1f0f6cdb5bff tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:35.792967 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-aa2685de-26ef-4f9b-8ce6-1f0f6cdb5bff tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 32b32f74-bb67-4c09-93a7-f25bdd84e216] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:35.803317 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-aa2685de-26ef-4f9b-8ce6-1f0f6cdb5bff tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:35.803786 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-aa2685de-26ef-4f9b-8ce6-1f0f6cdb5bff tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:35.804571 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-aa2685de-26ef-4f9b-8ce6-1f0f6cdb5bff tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:35.805495 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-aa2685de-26ef-4f9b-8ce6-1f0f6cdb5bff tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:35.819404 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-aa2685de-26ef-4f9b-8ce6-1f0f6cdb5bff tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] HTTP exception thrown: Instance 32b32f74-bb67-4c09-93a7-f25bdd84e216 could not be found. May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-aa2685de-26ef-4f9b-8ce6-1f0f6cdb5bff tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Request method failure captured: May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 HTTP/1.1 May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifR0_yVsXM175AFridJyhj9skspehb_ciOsHU26CEmHe_807tOyGWo7z4xJK60si5liawiwudFDSUYojtSoOFhhRhtJ2Mf7VLI9Vajp97ip8SIeCtwU9rgBz3UILZe82Qi76Xa3bsR6vOc_DQ6dxxDMJWMIvOa0HXNKUStIQdT_wKmtA May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: acae066a447040f98bf289109ed61c77 May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-VolumesActionsTest-942053235 May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:44:35.821086 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:44:35.822887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/acae066a447040f98bf289109ed61c77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/acae066a447040f98bf289109ed61c77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_acae066a447040f98bf289109ed61c77", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/acae066a447040f98bf289109ed61c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:44:35.822887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-VolumesActionsTest-942053235 May 12 14:44:35.822887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: acae066a447040f98bf289109ed61c77 May 12 14:44:35.822887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-VolumesActionsTest-942053235 May 12 14:44:35.822887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-VolumesActionsTest-942053235-project May 12 14:44:35.822887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:44:35.822887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:44:35.822887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: 426f0c09f59941b195964297fd3dc6b4 May 12 14:44:35.822887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-VolumesActionsTest-942053235-project May 12 14:44:35.822887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:44:35.822887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance 32b32f74-bb67-4c09-93a7-f25bdd84e216 could not be found. May 12 14:44:35.822887 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '32b32f74-bb67-4c09-93a7-f25bdd84e216'} May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32b32f74-bb67-4c09-93a7-f25bdd84e216 could not be found. May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:44:35.823867 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32b32f74-bb67-4c09-93a7-f25bdd84e216 could not be found. May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32b32f74-bb67-4c09-93a7-f25bdd84e216 could not be found. May 12 14:44:35.825646 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:44:35.828153 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-aa2685de-26ef-4f9b-8ce6-1f0f6cdb5bff tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Returning 404 to user: Instance 32b32f74-bb67-4c09-93a7-f25bdd84e216 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:44:35.828153 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-aa2685de-26ef-4f9b-8ce6-1f0f6cdb5bff tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216" status: 404 len: 111 microversion: 2.1 time: 0.035174 May 12 14:44:35.828153 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 655/1325] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:35 2022] GET /compute/v2.1/servers/32b32f74-bb67-4c09-93a7-f25bdd84e216 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:44:35.929110 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-577368550", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "networks": [{"uuid": "5477df79-3f77-4d26-bd44-a92ad32664f4"}]}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:35.979260 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.network.neutron [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] validate_networks() for [('5477df79-3f77-4d26-bd44-a92ad32664f4', None, None, None, None, None)] {{(pid=118217) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:44:36.326188 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Flavor limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:44:36.326618 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Image limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:44:36.327120 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Flavor pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:44:36.327534 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Image pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:44:36.327946 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:44:36.336392 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:36.336839 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:36.337691 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:36.338075 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:36.354059 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Getting quotas for project acae066a447040f98bf289109ed61c77. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:44:36.358382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Getting quotas for user 426f0c09f59941b195964297fd3dc6b4 and project acae066a447040f98bf289109ed61c77. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:44:36.369350 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Going to run 1 instances... {{(pid=118217) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:44:36.371745 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:44:36.416047 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bfaddc9f-e662-4375-afef-d0dcbf6f2d38 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491546 May 12 14:44:36.416695 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 671/1326] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:44:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:44:36.426992 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-626c05fb-68fc-4034-b6e7-ddaa881e67fa tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:36.427633 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-626c05fb-68fc-4034-b6e7-ddaa881e67fa tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:36.478803 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-626c05fb-68fc-4034-b6e7-ddaa881e67fa tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:36.485966 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-626c05fb-68fc-4034-b6e7-ddaa881e67fa tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 200 len: 1213 microversion: 2.1 time: 0.062730 May 12 14:44:36.486529 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 656/1327] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:36 2022] GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:37.503965 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-164865f6-eb2c-49f3-a049-476ce6f0b964 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:37.505229 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-164865f6-eb2c-49f3-a049-476ce6f0b964 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:37.512592 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-164865f6-eb2c-49f3-a049-476ce6f0b964 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:37.512844 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-164865f6-eb2c-49f3-a049-476ce6f0b964 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:37.514472 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-164865f6-eb2c-49f3-a049-476ce6f0b964 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:37.514980 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-164865f6-eb2c-49f3-a049-476ce6f0b964 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:37.603768 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-164865f6-eb2c-49f3-a049-476ce6f0b964 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:37.611170 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-164865f6-eb2c-49f3-a049-476ce6f0b964 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 200 len: 1271 microversion: 2.1 time: 0.111490 May 12 14:44:37.611741 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 672/1328] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:37 2022] GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 1271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:38.628783 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-95f689a1-7c79-4605-a24e-86e36ff7da3c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:38.629396 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-95f689a1-7c79-4605-a24e-86e36ff7da3c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:38.635273 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-95f689a1-7c79-4605-a24e-86e36ff7da3c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:38.635719 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-95f689a1-7c79-4605-a24e-86e36ff7da3c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:38.636485 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-95f689a1-7c79-4605-a24e-86e36ff7da3c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:38.636920 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-95f689a1-7c79-4605-a24e-86e36ff7da3c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:38.820399 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-95f689a1-7c79-4605-a24e-86e36ff7da3c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:38.828681 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-95f689a1-7c79-4605-a24e-86e36ff7da3c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 200 len: 1313 microversion: 2.1 time: 0.203936 May 12 14:44:38.829572 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 657/1329] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:38 2022] GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:38.879010 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-a5c7331a-abae-4b8c-80a8-9fb54962bd9c req-faa157c9-4e9b-4e7c-a143-f1e6c11935ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97847618-1f71-49ee-bdea-a3ba976f39d9", "tag": "6a68cc4b-e38e-4670-88cd-2547114bc580"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:38.890669 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-a5c7331a-abae-4b8c-80a8-9fb54962bd9c req-faa157c9-4e9b-4e7c-a143-f1e6c11935ac service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:38.891340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-a5c7331a-abae-4b8c-80a8-9fb54962bd9c req-faa157c9-4e9b-4e7c-a143-f1e6c11935ac service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:38.902937 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-a5c7331a-abae-4b8c-80a8-9fb54962bd9c req-faa157c9-4e9b-4e7c-a143-f1e6c11935ac service nova] Creating event network-changed:6a68cc4b-e38e-4670-88cd-2547114bc580 for instance 97847618-1f71-49ee-bdea-a3ba976f39d9 on hv-cinder-77703 May 12 14:44:38.908943 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-a5c7331a-abae-4b8c-80a8-9fb54962bd9c req-faa157c9-4e9b-4e7c-a143-f1e6c11935ac service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035018 May 12 14:44:38.909790 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 673/1330] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:44:39.845257 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3594dbd7-069c-4bfb-b192-51c128f5b8f3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:39.845896 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3594dbd7-069c-4bfb-b192-51c128f5b8f3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:39.852390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3594dbd7-069c-4bfb-b192-51c128f5b8f3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:39.852843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3594dbd7-069c-4bfb-b192-51c128f5b8f3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:39.853623 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3594dbd7-069c-4bfb-b192-51c128f5b8f3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:39.854066 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3594dbd7-069c-4bfb-b192-51c128f5b8f3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:39.981799 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3594dbd7-069c-4bfb-b192-51c128f5b8f3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:39.989704 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3594dbd7-069c-4bfb-b192-51c128f5b8f3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 200 len: 1313 microversion: 2.1 time: 0.148371 May 12 14:44:39.990318 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 658/1331] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:39 2022] GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:41.007899 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f391dffb-e0d1-4b81-8946-bf0c7d757001 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:41.008610 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f391dffb-e0d1-4b81-8946-bf0c7d757001 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:41.015328 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f391dffb-e0d1-4b81-8946-bf0c7d757001 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:41.015786 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f391dffb-e0d1-4b81-8946-bf0c7d757001 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:41.016557 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f391dffb-e0d1-4b81-8946-bf0c7d757001 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:41.017001 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f391dffb-e0d1-4b81-8946-bf0c7d757001 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:41.147472 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f391dffb-e0d1-4b81-8946-bf0c7d757001 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:41.155154 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f391dffb-e0d1-4b81-8946-bf0c7d757001 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 200 len: 1313 microversion: 2.1 time: 0.151708 May 12 14:44:41.155723 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 674/1332] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:41 2022] GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:42.172399 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-22f41921-6048-454a-ae49-67f0421bcba0 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:42.172951 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-22f41921-6048-454a-ae49-67f0421bcba0 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:42.179282 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-22f41921-6048-454a-ae49-67f0421bcba0 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:42.179736 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-22f41921-6048-454a-ae49-67f0421bcba0 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:42.180503 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-22f41921-6048-454a-ae49-67f0421bcba0 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:42.180939 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-22f41921-6048-454a-ae49-67f0421bcba0 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:42.305239 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-22f41921-6048-454a-ae49-67f0421bcba0 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:42.312423 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-22f41921-6048-454a-ae49-67f0421bcba0 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 200 len: 1313 microversion: 2.1 time: 0.144587 May 12 14:44:42.312998 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 659/1333] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:42 2022] GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:43.329224 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-f17884a8-317b-41da-9c99-c1fdcb364210 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:43.329838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-f17884a8-317b-41da-9c99-c1fdcb364210 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:43.336097 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f17884a8-317b-41da-9c99-c1fdcb364210 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:43.336553 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f17884a8-317b-41da-9c99-c1fdcb364210 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:43.337320 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f17884a8-317b-41da-9c99-c1fdcb364210 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:43.337756 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-f17884a8-317b-41da-9c99-c1fdcb364210 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:43.466592 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-f17884a8-317b-41da-9c99-c1fdcb364210 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:43.474827 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-f17884a8-317b-41da-9c99-c1fdcb364210 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 200 len: 1313 microversion: 2.1 time: 0.149466 May 12 14:44:43.475473 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 675/1334] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:43 2022] GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:44.492437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-810cd9c6-86d0-4f35-aace-11cd1d21ddd3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:44.493056 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-810cd9c6-86d0-4f35-aace-11cd1d21ddd3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:44.500661 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-810cd9c6-86d0-4f35-aace-11cd1d21ddd3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:44.501114 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-810cd9c6-86d0-4f35-aace-11cd1d21ddd3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:44.501884 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-810cd9c6-86d0-4f35-aace-11cd1d21ddd3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:44.502323 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-810cd9c6-86d0-4f35-aace-11cd1d21ddd3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:44.630192 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-810cd9c6-86d0-4f35-aace-11cd1d21ddd3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:44.637245 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-810cd9c6-86d0-4f35-aace-11cd1d21ddd3 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 200 len: 1313 microversion: 2.1 time: 0.148848 May 12 14:44:44.637810 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 660/1335] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:44 2022] GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:45.409040 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-b71e684d-89f7-4835-839e-3df01fb87147 req-f6cabdf2-2866-4b86-9ab4-5507c8b8f778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97847618-1f71-49ee-bdea-a3ba976f39d9", "name": "network-vif-plugged", "status": "completed", "tag": "6a68cc4b-e38e-4670-88cd-2547114bc580"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:45.417300 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-b71e684d-89f7-4835-839e-3df01fb87147 req-f6cabdf2-2866-4b86-9ab4-5507c8b8f778 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:45.417890 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-b71e684d-89f7-4835-839e-3df01fb87147 req-f6cabdf2-2866-4b86-9ab4-5507c8b8f778 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:45.429450 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-b71e684d-89f7-4835-839e-3df01fb87147 req-f6cabdf2-2866-4b86-9ab4-5507c8b8f778 service nova] Creating event network-vif-plugged:6a68cc4b-e38e-4670-88cd-2547114bc580 for instance 97847618-1f71-49ee-bdea-a3ba976f39d9 on hv-cinder-77703 May 12 14:44:45.434299 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-b71e684d-89f7-4835-839e-3df01fb87147 req-f6cabdf2-2866-4b86-9ab4-5507c8b8f778 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028962 May 12 14:44:45.434930 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 676/1336] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:44:45.654026 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-7875a96d-f9df-4e97-b44a-fdd72d4d7554 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:45.655808 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-7875a96d-f9df-4e97-b44a-fdd72d4d7554 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:45.661830 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7875a96d-f9df-4e97-b44a-fdd72d4d7554 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:45.662294 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7875a96d-f9df-4e97-b44a-fdd72d4d7554 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:45.663100 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7875a96d-f9df-4e97-b44a-fdd72d4d7554 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:45.663543 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-7875a96d-f9df-4e97-b44a-fdd72d4d7554 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:45.791321 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-7875a96d-f9df-4e97-b44a-fdd72d4d7554 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:45.799158 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-7875a96d-f9df-4e97-b44a-fdd72d4d7554 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 200 len: 1313 microversion: 2.1 time: 0.149106 May 12 14:44:45.799724 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 661/1337] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:45 2022] GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:46.816831 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c8c0d3ad-b144-449c-8993-5d979c34105a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:46.817553 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c8c0d3ad-b144-449c-8993-5d979c34105a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:46.823735 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c8c0d3ad-b144-449c-8993-5d979c34105a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:46.824188 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c8c0d3ad-b144-449c-8993-5d979c34105a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:46.824957 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c8c0d3ad-b144-449c-8993-5d979c34105a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:46.825392 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c8c0d3ad-b144-449c-8993-5d979c34105a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:46.952186 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c8c0d3ad-b144-449c-8993-5d979c34105a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:46.960152 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c8c0d3ad-b144-449c-8993-5d979c34105a tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 200 len: 1313 microversion: 2.1 time: 0.148050 May 12 14:44:46.960934 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 677/1338] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:46 2022] GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:47.977631 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-932d0a0b-2950-433c-8797-ee9339f349bf tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:47.978259 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-932d0a0b-2950-433c-8797-ee9339f349bf tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:47.985218 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-932d0a0b-2950-433c-8797-ee9339f349bf tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:47.985675 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-932d0a0b-2950-433c-8797-ee9339f349bf tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:47.986899 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-932d0a0b-2950-433c-8797-ee9339f349bf tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:47.987147 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-932d0a0b-2950-433c-8797-ee9339f349bf tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:48.120860 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-932d0a0b-2950-433c-8797-ee9339f349bf tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:48.128080 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-932d0a0b-2950-433c-8797-ee9339f349bf tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 200 len: 1497 microversion: 2.1 time: 0.154425 May 12 14:44:48.128643 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 662/1339] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:47 2022] GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:48.618530 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-cd7bd2c8-faa6-4921-b1c7-4c9103161be9 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:48.619356 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-cd7bd2c8-faa6-4921-b1c7-4c9103161be9 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:48.626141 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cd7bd2c8-faa6-4921-b1c7-4c9103161be9 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:48.626592 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cd7bd2c8-faa6-4921-b1c7-4c9103161be9 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:48.627385 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cd7bd2c8-faa6-4921-b1c7-4c9103161be9 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:48.627824 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cd7bd2c8-faa6-4921-b1c7-4c9103161be9 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:48.652331 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-cd7bd2c8-faa6-4921-b1c7-4c9103161be9 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Going to try to terminate instance {{(pid=118217) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:44:48.724068 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-cd7bd2c8-faa6-4921-b1c7-4c9103161be9 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "DELETE /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 204 len: 0 microversion: 2.1 time: 0.109140 May 12 14:44:48.724779 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 678/1340] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:44:48 2022] DELETE /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:44:48.733199 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ff3db66f-8494-4367-b17a-7903c3e7bfdd tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:48.733848 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ff3db66f-8494-4367-b17a-7903c3e7bfdd tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:48.739716 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff3db66f-8494-4367-b17a-7903c3e7bfdd tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:48.740256 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff3db66f-8494-4367-b17a-7903c3e7bfdd tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:48.741023 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff3db66f-8494-4367-b17a-7903c3e7bfdd tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:48.741457 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ff3db66f-8494-4367-b17a-7903c3e7bfdd tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:48.867368 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ff3db66f-8494-4367-b17a-7903c3e7bfdd tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:48.875389 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ff3db66f-8494-4367-b17a-7903c3e7bfdd tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 200 len: 1503 microversion: 2.1 time: 0.145483 May 12 14:44:48.875961 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 663/1341] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:48 2022] GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:44:49.945215 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bcd9873d-09e6-4861-99ca-e7429cd7612f tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:49.945926 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bcd9873d-09e6-4861-99ca-e7429cd7612f tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:49.952296 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bcd9873d-09e6-4861-99ca-e7429cd7612f tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:49.952752 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bcd9873d-09e6-4861-99ca-e7429cd7612f tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:49.953524 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bcd9873d-09e6-4861-99ca-e7429cd7612f tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:49.953967 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bcd9873d-09e6-4861-99ca-e7429cd7612f tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:50.077661 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bcd9873d-09e6-4861-99ca-e7429cd7612f tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:50.084944 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bcd9873d-09e6-4861-99ca-e7429cd7612f tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 200 len: 1503 microversion: 2.1 time: 0.144027 May 12 14:44:50.085519 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 679/1342] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:49 2022] GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 1503 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:50.952459 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-e851249e-3422-4ca0-b97e-8ca02f17a879 req-36301c4b-eb3f-4078-b429-7b4688d9473c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97847618-1f71-49ee-bdea-a3ba976f39d9", "name": "network-vif-deleted", "tag": "6a68cc4b-e38e-4670-88cd-2547114bc580"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:44:50.963843 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-e851249e-3422-4ca0-b97e-8ca02f17a879 req-36301c4b-eb3f-4078-b429-7b4688d9473c service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:50.964290 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-e851249e-3422-4ca0-b97e-8ca02f17a879 req-36301c4b-eb3f-4078-b429-7b4688d9473c service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:50.976015 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-e851249e-3422-4ca0-b97e-8ca02f17a879 req-36301c4b-eb3f-4078-b429-7b4688d9473c service nova] Creating event network-vif-deleted:6a68cc4b-e38e-4670-88cd-2547114bc580 for instance 97847618-1f71-49ee-bdea-a3ba976f39d9 on hv-cinder-77703 May 12 14:44:50.981254 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-e851249e-3422-4ca0-b97e-8ca02f17a879 req-36301c4b-eb3f-4078-b429-7b4688d9473c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032362 May 12 14:44:50.981932 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 664/1343] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:44:51.102588 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-94e2ba15-57cb-47e4-ac83-9a9565a6a944 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:51.103237 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-94e2ba15-57cb-47e4-ac83-9a9565a6a944 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:51.109739 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-94e2ba15-57cb-47e4-ac83-9a9565a6a944 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:51.110203 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-94e2ba15-57cb-47e4-ac83-9a9565a6a944 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:51.110985 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-94e2ba15-57cb-47e4-ac83-9a9565a6a944 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:51.111457 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-94e2ba15-57cb-47e4-ac83-9a9565a6a944 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:51.143081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-94e2ba15-57cb-47e4-ac83-9a9565a6a944 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:51.143452 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-94e2ba15-57cb-47e4-ac83-9a9565a6a944 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:51.143906 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-94e2ba15-57cb-47e4-ac83-9a9565a6a944 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lazy-loading 'fault' on Instance uuid 97847618-1f71-49ee-bdea-a3ba976f39d9 {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:44:51.182672 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-94e2ba15-57cb-47e4-ac83-9a9565a6a944 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426f0c09f59941b195964297fd3dc6b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acae066a447040f98bf289109ed61c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:44:51.190297 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-94e2ba15-57cb-47e4-ac83-9a9565a6a944 tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 200 len: 1303 microversion: 2.1 time: 0.091683 May 12 14:44:51.190870 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 680/1344] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:51 2022] GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:44:52.208498 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1714deac-41c7-4d3e-85d0-6cec852d7e1c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:44:52.209197 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1714deac-41c7-4d3e-85d0-6cec852d7e1c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] [instance: 97847618-1f71-49ee-bdea-a3ba976f39d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:44:52.215384 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1714deac-41c7-4d3e-85d0-6cec852d7e1c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:52.215831 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1714deac-41c7-4d3e-85d0-6cec852d7e1c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:52.216643 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1714deac-41c7-4d3e-85d0-6cec852d7e1c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:44:52.217376 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1714deac-41c7-4d3e-85d0-6cec852d7e1c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:44:52.230670 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-1714deac-41c7-4d3e-85d0-6cec852d7e1c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] HTTP exception thrown: Instance 97847618-1f71-49ee-bdea-a3ba976f39d9 could not be found. May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1714deac-41c7-4d3e-85d0-6cec852d7e1c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Request method failure captured: May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 HTTP/1.1 May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifR0_yVsXM175AFridJyhj9skspehb_ciOsHU26CEmHe_807tOyGWo7z4xJK60si5liawiwudFDSUYojtSoOFhhRhtJ2Mf7VLI9Vajp97ip8SIeCtwU9rgBz3UILZe82Qi76Xa3bsR6vOc_DQ6dxxDMJWMIvOa0HXNKUStIQdT_wKmtA May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: acae066a447040f98bf289109ed61c77 May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-VolumesActionsTest-942053235 May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:44:52.232288 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:44:52.233971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/acae066a447040f98bf289109ed61c77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/acae066a447040f98bf289109ed61c77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_acae066a447040f98bf289109ed61c77", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/acae066a447040f98bf289109ed61c77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:44:52.233971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-VolumesActionsTest-942053235 May 12 14:44:52.233971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: acae066a447040f98bf289109ed61c77 May 12 14:44:52.233971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-VolumesActionsTest-942053235 May 12 14:44:52.233971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-VolumesActionsTest-942053235-project May 12 14:44:52.233971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:44:52.233971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:44:52.233971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: 426f0c09f59941b195964297fd3dc6b4 May 12 14:44:52.233971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-VolumesActionsTest-942053235-project May 12 14:44:52.233971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:44:52.233971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance 97847618-1f71-49ee-bdea-a3ba976f39d9 could not be found. May 12 14:44:52.233971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': '97847618-1f71-49ee-bdea-a3ba976f39d9'} May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97847618-1f71-49ee-bdea-a3ba976f39d9 could not be found. May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:44:52.235160 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97847618-1f71-49ee-bdea-a3ba976f39d9 could not be found. May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97847618-1f71-49ee-bdea-a3ba976f39d9 could not be found. May 12 14:44:52.236662 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:44:52.238121 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1714deac-41c7-4d3e-85d0-6cec852d7e1c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] Returning 404 to user: Instance 97847618-1f71-49ee-bdea-a3ba976f39d9 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:44:52.238121 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1714deac-41c7-4d3e-85d0-6cec852d7e1c tempest-VolumesActionsTest-942053235 tempest-VolumesActionsTest-942053235-project] 10.222.0.75 "GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9" status: 404 len: 111 microversion: 2.1 time: 0.029833 May 12 14:44:52.238121 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 665/1345] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:44:52 2022] GET /compute/v2.1/servers/97847618-1f71-49ee-bdea-a3ba976f39d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:45:01.860496 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3272ea8f-6309-4c89-aef6-fafd02b63072 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:01.861131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3272ea8f-6309-4c89-aef6-fafd02b63072 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:01.868004 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3272ea8f-6309-4c89-aef6-fafd02b63072 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:01.868456 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3272ea8f-6309-4c89-aef6-fafd02b63072 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:01.869521 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3272ea8f-6309-4c89-aef6-fafd02b63072 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:01.869964 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3272ea8f-6309-4c89-aef6-fafd02b63072 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:01.960877 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-3272ea8f-6309-4c89-aef6-fafd02b63072 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lazy-loading 'services' on Instance uuid b4b68e00-a067-4696-b0d5-2cc050569c72 {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:45:02.056382 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3272ea8f-6309-4c89-aef6-fafd02b63072 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/os-volume_attachments/e3b456ee-dc97-4cd7-866f-24446109ee87" status: 202 len: 0 microversion: 2.1 time: 0.199941 May 12 14:45:02.060195 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 681/1346] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 12 14:45:01 2022] DELETE /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/os-volume_attachments/e3b456ee-dc97-4cd7-866f-24446109ee87 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:45:04.258994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-41f8c62c-b029-4387-a93b-844d852abbc5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:45:04.266804 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-41f8c62c-b029-4387-a93b-844d852abbc5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:04.267355 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-41f8c62c-b029-4387-a93b-844d852abbc5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:04.329136 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-41f8c62c-b029-4387-a93b-844d852abbc5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Going to try to stop instance {{(pid=118216) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 14:45:04.381756 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-41f8c62c-b029-4387-a93b-844d852abbc5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "POST /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/action" status: 202 len: 0 microversion: 2.1 time: 0.126502 May 12 14:45:04.382771 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 666/1347] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 12 14:45:04 2022] POST /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:45:04.393941 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4d91f099-65ba-47a4-8d74-9a0248cb994b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:04.395573 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4d91f099-65ba-47a4-8d74-9a0248cb994b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:04.408878 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4d91f099-65ba-47a4-8d74-9a0248cb994b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:04.410372 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4d91f099-65ba-47a4-8d74-9a0248cb994b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:04.411577 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4d91f099-65ba-47a4-8d74-9a0248cb994b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:04.412323 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4d91f099-65ba-47a4-8d74-9a0248cb994b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:04.592871 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-4d91f099-65ba-47a4-8d74-9a0248cb994b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:04.601366 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4d91f099-65ba-47a4-8d74-9a0248cb994b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1677 microversion: 2.1 time: 0.213578 May 12 14:45:04.602010 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 682/1348] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:04 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:05.622226 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ad61386b-045b-423d-bad0-176310ee337d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:05.622939 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ad61386b-045b-423d-bad0-176310ee337d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:05.630679 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ad61386b-045b-423d-bad0-176310ee337d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:05.631261 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ad61386b-045b-423d-bad0-176310ee337d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:05.632146 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ad61386b-045b-423d-bad0-176310ee337d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:05.632819 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ad61386b-045b-423d-bad0-176310ee337d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:05.789037 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ad61386b-045b-423d-bad0-176310ee337d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:05.798933 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ad61386b-045b-423d-bad0-176310ee337d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1677 microversion: 2.1 time: 0.181769 May 12 14:45:05.799768 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 667/1349] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:05 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:06.829968 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c2ac4205-e96d-4d71-b464-e5cc8686e003 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:06.830592 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c2ac4205-e96d-4d71-b464-e5cc8686e003 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:06.837590 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c2ac4205-e96d-4d71-b464-e5cc8686e003 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:06.838902 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c2ac4205-e96d-4d71-b464-e5cc8686e003 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:06.839782 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c2ac4205-e96d-4d71-b464-e5cc8686e003 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:06.840239 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c2ac4205-e96d-4d71-b464-e5cc8686e003 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:06.980640 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c2ac4205-e96d-4d71-b464-e5cc8686e003 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:06.989286 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c2ac4205-e96d-4d71-b464-e5cc8686e003 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1677 microversion: 2.1 time: 0.163945 May 12 14:45:06.989886 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 683/1350] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:06 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:08.009839 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-0062da57-5b8e-499a-b234-175560b8b8ef tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:08.010776 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-0062da57-5b8e-499a-b234-175560b8b8ef tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:08.021657 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0062da57-5b8e-499a-b234-175560b8b8ef tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:08.022586 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0062da57-5b8e-499a-b234-175560b8b8ef tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:08.024034 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0062da57-5b8e-499a-b234-175560b8b8ef tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:08.024918 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-0062da57-5b8e-499a-b234-175560b8b8ef tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:08.185786 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-0062da57-5b8e-499a-b234-175560b8b8ef tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:08.201335 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-0062da57-5b8e-499a-b234-175560b8b8ef tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1677 microversion: 2.1 time: 0.197759 May 12 14:45:08.203630 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 668/1351] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:08 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:09.224612 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1c9ad3ce-aecf-4207-8e5d-1e38bcce39dd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:09.225270 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1c9ad3ce-aecf-4207-8e5d-1e38bcce39dd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:09.232616 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1c9ad3ce-aecf-4207-8e5d-1e38bcce39dd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:09.233084 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1c9ad3ce-aecf-4207-8e5d-1e38bcce39dd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:09.234448 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1c9ad3ce-aecf-4207-8e5d-1e38bcce39dd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:09.235116 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1c9ad3ce-aecf-4207-8e5d-1e38bcce39dd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:09.399672 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1c9ad3ce-aecf-4207-8e5d-1e38bcce39dd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:09.408750 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1c9ad3ce-aecf-4207-8e5d-1e38bcce39dd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1677 microversion: 2.1 time: 0.188203 May 12 14:45:09.409357 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 684/1352] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:09 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:10.426062 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-928eb448-500a-47a4-9edb-06d39f89963e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:10.426753 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-928eb448-500a-47a4-9edb-06d39f89963e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:10.433461 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-928eb448-500a-47a4-9edb-06d39f89963e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:10.433925 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-928eb448-500a-47a4-9edb-06d39f89963e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:10.434728 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-928eb448-500a-47a4-9edb-06d39f89963e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:10.435193 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-928eb448-500a-47a4-9edb-06d39f89963e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:10.581491 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-928eb448-500a-47a4-9edb-06d39f89963e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:10.589777 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-928eb448-500a-47a4-9edb-06d39f89963e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1677 microversion: 2.1 time: 0.167856 May 12 14:45:10.590374 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 669/1353] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:10 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:11.609020 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5a367355-1826-4f4a-a913-9acf4fae331e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:11.609682 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5a367355-1826-4f4a-a913-9acf4fae331e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:11.616461 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5a367355-1826-4f4a-a913-9acf4fae331e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:11.617160 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5a367355-1826-4f4a-a913-9acf4fae331e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:11.618131 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5a367355-1826-4f4a-a913-9acf4fae331e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:11.618733 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5a367355-1826-4f4a-a913-9acf4fae331e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:11.785835 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5a367355-1826-4f4a-a913-9acf4fae331e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:11.793845 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5a367355-1826-4f4a-a913-9acf4fae331e tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1677 microversion: 2.1 time: 0.189027 May 12 14:45:11.794425 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 685/1354] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:11 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:12.815574 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f4e94278-8246-49f1-8a81-45409d7b22c3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:12.816328 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f4e94278-8246-49f1-8a81-45409d7b22c3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:12.822882 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f4e94278-8246-49f1-8a81-45409d7b22c3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:12.823410 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f4e94278-8246-49f1-8a81-45409d7b22c3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:12.824201 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f4e94278-8246-49f1-8a81-45409d7b22c3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:12.824649 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f4e94278-8246-49f1-8a81-45409d7b22c3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:12.975426 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f4e94278-8246-49f1-8a81-45409d7b22c3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:12.982927 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f4e94278-8246-49f1-8a81-45409d7b22c3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1677 microversion: 2.1 time: 0.171826 May 12 14:45:12.998475 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 670/1355] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:12 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:14.004980 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bb39f476-d05c-47e5-a1f0-88e387259d76 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:14.005634 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bb39f476-d05c-47e5-a1f0-88e387259d76 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:14.012236 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bb39f476-d05c-47e5-a1f0-88e387259d76 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:14.012699 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bb39f476-d05c-47e5-a1f0-88e387259d76 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:14.013473 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bb39f476-d05c-47e5-a1f0-88e387259d76 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:14.013917 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bb39f476-d05c-47e5-a1f0-88e387259d76 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:14.139104 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bb39f476-d05c-47e5-a1f0-88e387259d76 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:14.146981 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bb39f476-d05c-47e5-a1f0-88e387259d76 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1677 microversion: 2.1 time: 0.145863 May 12 14:45:14.147584 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 686/1356] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:13 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:15.164344 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-cbc28262-5d4e-4d94-8ae2-74f1df5285c8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:15.164875 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-cbc28262-5d4e-4d94-8ae2-74f1df5285c8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:15.171073 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cbc28262-5d4e-4d94-8ae2-74f1df5285c8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:15.171535 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cbc28262-5d4e-4d94-8ae2-74f1df5285c8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:15.172295 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cbc28262-5d4e-4d94-8ae2-74f1df5285c8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:15.172731 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-cbc28262-5d4e-4d94-8ae2-74f1df5285c8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:15.305367 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-cbc28262-5d4e-4d94-8ae2-74f1df5285c8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:15.313271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-cbc28262-5d4e-4d94-8ae2-74f1df5285c8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1677 microversion: 2.1 time: 0.153175 May 12 14:45:15.313846 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 671/1357] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:15 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:16.330515 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8aa50960-88ff-474d-a60c-4a38e4b19640 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:16.331164 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8aa50960-88ff-474d-a60c-4a38e4b19640 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:16.337925 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8aa50960-88ff-474d-a60c-4a38e4b19640 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:16.338386 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8aa50960-88ff-474d-a60c-4a38e4b19640 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:16.339191 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8aa50960-88ff-474d-a60c-4a38e4b19640 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:16.339649 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8aa50960-88ff-474d-a60c-4a38e4b19640 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:16.465375 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8aa50960-88ff-474d-a60c-4a38e4b19640 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:16.473074 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8aa50960-88ff-474d-a60c-4a38e4b19640 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1677 microversion: 2.1 time: 0.146985 May 12 14:45:16.473644 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 687/1358] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:16 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:17.489907 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-f420cb8f-8423-4dfb-8d08-a7820e1c0b92 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:17.490516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-f420cb8f-8423-4dfb-8d08-a7820e1c0b92 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:17.497155 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f420cb8f-8423-4dfb-8d08-a7820e1c0b92 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:17.497604 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f420cb8f-8423-4dfb-8d08-a7820e1c0b92 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:17.498369 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f420cb8f-8423-4dfb-8d08-a7820e1c0b92 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:17.498805 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-f420cb8f-8423-4dfb-8d08-a7820e1c0b92 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:17.628437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-f420cb8f-8423-4dfb-8d08-a7820e1c0b92 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:17.636596 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-f420cb8f-8423-4dfb-8d08-a7820e1c0b92 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1677 microversion: 2.1 time: 0.150480 May 12 14:45:17.637208 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 672/1359] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:17 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:18.654759 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-e006a4d7-7b3c-4159-89e4-4a27b12ea26b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:18.655506 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-e006a4d7-7b3c-4159-89e4-4a27b12ea26b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:18.662313 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e006a4d7-7b3c-4159-89e4-4a27b12ea26b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:18.662787 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e006a4d7-7b3c-4159-89e4-4a27b12ea26b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:18.663670 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e006a4d7-7b3c-4159-89e4-4a27b12ea26b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:18.664170 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-e006a4d7-7b3c-4159-89e4-4a27b12ea26b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:18.795594 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-e006a4d7-7b3c-4159-89e4-4a27b12ea26b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:18.803146 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-e006a4d7-7b3c-4159-89e4-4a27b12ea26b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1677 microversion: 2.1 time: 0.152726 May 12 14:45:18.803725 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 688/1360] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:18 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:19.820321 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3301f556-ecd4-4cec-a7bd-c2a9cf4da1fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:19.820979 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-3301f556-ecd4-4cec-a7bd-c2a9cf4da1fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:19.827408 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3301f556-ecd4-4cec-a7bd-c2a9cf4da1fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:19.827864 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3301f556-ecd4-4cec-a7bd-c2a9cf4da1fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:19.828642 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3301f556-ecd4-4cec-a7bd-c2a9cf4da1fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:19.829087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-3301f556-ecd4-4cec-a7bd-c2a9cf4da1fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:19.966616 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-3301f556-ecd4-4cec-a7bd-c2a9cf4da1fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:19.974038 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3301f556-ecd4-4cec-a7bd-c2a9cf4da1fb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1677 microversion: 2.1 time: 0.157629 May 12 14:45:19.974613 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 673/1361] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:19 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:20.991718 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-d782277f-94fb-42bf-b26d-0dbd08396f5b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:20.992342 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-d782277f-94fb-42bf-b26d-0dbd08396f5b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:21.004918 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d782277f-94fb-42bf-b26d-0dbd08396f5b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:21.005395 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d782277f-94fb-42bf-b26d-0dbd08396f5b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:21.006896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d782277f-94fb-42bf-b26d-0dbd08396f5b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:21.006896 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-d782277f-94fb-42bf-b26d-0dbd08396f5b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:21.216195 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-d782277f-94fb-42bf-b26d-0dbd08396f5b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:21.224334 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-d782277f-94fb-42bf-b26d-0dbd08396f5b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1654 microversion: 2.1 time: 0.236495 May 12 14:45:21.224914 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 689/1362] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:20 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1654 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:21.244733 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-95d8e956-da03-47aa-8618-c0f4fd19d2f7 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:45:21.251455 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-95d8e956-da03-47aa-8618-c0f4fd19d2f7 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:21.251904 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-95d8e956-da03-47aa-8618-c0f4fd19d2f7 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:21.275011 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-95d8e956-da03-47aa-8618-c0f4fd19d2f7 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Going to try to start instance {{(pid=118216) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 14:45:21.324567 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-95d8e956-da03-47aa-8618-c0f4fd19d2f7 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "POST /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/action" status: 202 len: 0 microversion: 2.1 time: 0.083724 May 12 14:45:21.325182 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 674/1363] 10.222.0.75 () {60 vars in 1277 bytes} [Thu May 12 14:45:21 2022] POST /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:45:21.335178 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1829fa88-5ea5-4666-ad2e-f3582f5c3f6b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:21.335924 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1829fa88-5ea5-4666-ad2e-f3582f5c3f6b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:21.342905 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1829fa88-5ea5-4666-ad2e-f3582f5c3f6b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:21.343621 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1829fa88-5ea5-4666-ad2e-f3582f5c3f6b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:21.345630 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1829fa88-5ea5-4666-ad2e-f3582f5c3f6b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:21.345630 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1829fa88-5ea5-4666-ad2e-f3582f5c3f6b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:21.636684 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1829fa88-5ea5-4666-ad2e-f3582f5c3f6b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:21.644892 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1829fa88-5ea5-4666-ad2e-f3582f5c3f6b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1663 microversion: 2.1 time: 0.314145 May 12 14:45:21.645476 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 690/1364] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:21 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1663 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:22.663233 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1dfa287f-47d0-4f86-bf5f-eecab2e45be7 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:22.663937 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1dfa287f-47d0-4f86-bf5f-eecab2e45be7 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:22.670053 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1dfa287f-47d0-4f86-bf5f-eecab2e45be7 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:22.670505 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1dfa287f-47d0-4f86-bf5f-eecab2e45be7 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:22.671372 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1dfa287f-47d0-4f86-bf5f-eecab2e45be7 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:22.671813 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1dfa287f-47d0-4f86-bf5f-eecab2e45be7 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:22.816629 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1dfa287f-47d0-4f86-bf5f-eecab2e45be7 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:22.824281 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1dfa287f-47d0-4f86-bf5f-eecab2e45be7 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1663 microversion: 2.1 time: 0.165764 May 12 14:45:22.824846 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 675/1365] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:22 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:45:23.842292 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-485d4010-b85d-4d63-97a4-0bef89ebdf9b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:23.842951 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-485d4010-b85d-4d63-97a4-0bef89ebdf9b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:45:23.849697 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-485d4010-b85d-4d63-97a4-0bef89ebdf9b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:23.850152 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-485d4010-b85d-4d63-97a4-0bef89ebdf9b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:23.850926 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-485d4010-b85d-4d63-97a4-0bef89ebdf9b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:45:23.851412 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-485d4010-b85d-4d63-97a4-0bef89ebdf9b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:45:23.982055 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-485d4010-b85d-4d63-97a4-0bef89ebdf9b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:45:23.989375 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-485d4010-b85d-4d63-97a4-0bef89ebdf9b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1667 microversion: 2.1 time: 0.151124 May 12 14:45:23.989971 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 691/1366] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:45:23 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:27.935114 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:46:27.935797 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Thu May 12 14:46:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:46:36.105493 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-04b291ed-fd39-4e46-8b68-fc05a536172d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:36.106417 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-04b291ed-fd39-4e46-8b68-fc05a536172d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:36.112294 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-04b291ed-fd39-4e46-8b68-fc05a536172d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:36.112747 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-04b291ed-fd39-4e46-8b68-fc05a536172d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:36.113516 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-04b291ed-fd39-4e46-8b68-fc05a536172d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:36.114477 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-04b291ed-fd39-4e46-8b68-fc05a536172d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:36.147953 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-04b291ed-fd39-4e46-8b68-fc05a536172d tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047099 May 12 14:46:36.148455 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 676/1367] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:46:36 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:46:36.206766 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-78ed0d7f-ff6e-4fec-ace8-edb4b86bf4a8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:36.207299 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-78ed0d7f-ff6e-4fec-ace8-edb4b86bf4a8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:36.213345 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-78ed0d7f-ff6e-4fec-ace8-edb4b86bf4a8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:36.213807 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-78ed0d7f-ff6e-4fec-ace8-edb4b86bf4a8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:36.214587 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-78ed0d7f-ff6e-4fec-ace8-edb4b86bf4a8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:36.215053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-78ed0d7f-ff6e-4fec-ace8-edb4b86bf4a8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:36.238856 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-78ed0d7f-ff6e-4fec-ace8-edb4b86bf4a8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Going to try to terminate instance {{(pid=118217) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:46:36.323912 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-78ed0d7f-ff6e-4fec-ace8-edb4b86bf4a8 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 204 len: 0 microversion: 2.1 time: 0.121682 May 12 14:46:36.324488 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 692/1368] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:46:36 2022] DELETE /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:46:36.333146 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-65112340-5626-48b3-a7d6-aea752fb3917 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:36.333763 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-65112340-5626-48b3-a7d6-aea752fb3917 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:36.339999 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-65112340-5626-48b3-a7d6-aea752fb3917 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:36.340462 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-65112340-5626-48b3-a7d6-aea752fb3917 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:36.341238 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-65112340-5626-48b3-a7d6-aea752fb3917 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:36.341681 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-65112340-5626-48b3-a7d6-aea752fb3917 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:36.653423 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-65112340-5626-48b3-a7d6-aea752fb3917 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:36.663571 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-65112340-5626-48b3-a7d6-aea752fb3917 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1673 microversion: 2.1 time: 0.331529 May 12 14:46:36.664170 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 677/1369] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:46:36 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1673 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:46:37.189103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:46:37.189717 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Thu May 12 14:46:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:46:37.681952 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c315c2d8-92b0-4450-85d0-fb4b58baeb89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:37.682595 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c315c2d8-92b0-4450-85d0-fb4b58baeb89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:37.689024 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c315c2d8-92b0-4450-85d0-fb4b58baeb89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:37.689487 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c315c2d8-92b0-4450-85d0-fb4b58baeb89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:37.690267 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c315c2d8-92b0-4450-85d0-fb4b58baeb89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:37.690710 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c315c2d8-92b0-4450-85d0-fb4b58baeb89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:37.962843 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-c315c2d8-92b0-4450-85d0-fb4b58baeb89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:37.970454 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c315c2d8-92b0-4450-85d0-fb4b58baeb89 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1673 microversion: 2.1 time: 0.292808 May 12 14:46:37.971056 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 693/1370] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:46:37 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1673 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:38.580224 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-a2fc52e6-d3ba-4459-a1ce-627838fe7cca req-88801f4a-9c1a-4198-8820-a89cbe153434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b68e00-a067-4696-b0d5-2cc050569c72", "name": "network-vif-deleted", "tag": "43202a5c-79c7-46ed-8988-a1031b1e8e9a"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:46:38.589457 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-a2fc52e6-d3ba-4459-a1ce-627838fe7cca req-88801f4a-9c1a-4198-8820-a89cbe153434 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:38.589909 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-a2fc52e6-d3ba-4459-a1ce-627838fe7cca req-88801f4a-9c1a-4198-8820-a89cbe153434 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:38.600397 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-a2fc52e6-d3ba-4459-a1ce-627838fe7cca req-88801f4a-9c1a-4198-8820-a89cbe153434 service nova] Creating event network-vif-deleted:43202a5c-79c7-46ed-8988-a1031b1e8e9a for instance b4b68e00-a067-4696-b0d5-2cc050569c72 on hv-cinder-77703 May 12 14:46:38.605860 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-a2fc52e6-d3ba-4459-a1ce-627838fe7cca req-88801f4a-9c1a-4198-8820-a89cbe153434 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029328 May 12 14:46:38.606797 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 678/1371] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:38.988058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-657f7664-5a57-431a-ba41-1b35318aa509 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:38.988680 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-657f7664-5a57-431a-ba41-1b35318aa509 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:38.996188 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-657f7664-5a57-431a-ba41-1b35318aa509 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:38.996654 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-657f7664-5a57-431a-ba41-1b35318aa509 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:38.998038 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-657f7664-5a57-431a-ba41-1b35318aa509 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:38.998038 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-657f7664-5a57-431a-ba41-1b35318aa509 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:39.030782 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-657f7664-5a57-431a-ba41-1b35318aa509 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:39.031354 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-657f7664-5a57-431a-ba41-1b35318aa509 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:39.031807 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.objects.instance [None req-657f7664-5a57-431a-ba41-1b35318aa509 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lazy-loading 'fault' on Instance uuid b4b68e00-a067-4696-b0d5-2cc050569c72 {{(pid=118217) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:46:39.075095 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-657f7664-5a57-431a-ba41-1b35318aa509 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:39.081816 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-657f7664-5a57-431a-ba41-1b35318aa509 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 200 len: 1327 microversion: 2.1 time: 0.097675 May 12 14:46:39.083385 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 694/1372] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:46:38 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:40.102268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c9c5ed2d-f851-4c11-b967-5df8b2b4c1c9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:40.103020 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c9c5ed2d-f851-4c11-b967-5df8b2b4c1c9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:40.109384 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c9c5ed2d-f851-4c11-b967-5df8b2b4c1c9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:40.109831 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c9c5ed2d-f851-4c11-b967-5df8b2b4c1c9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:40.110596 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c9c5ed2d-f851-4c11-b967-5df8b2b4c1c9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:40.111047 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c9c5ed2d-f851-4c11-b967-5df8b2b4c1c9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:40.125215 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-c9c5ed2d-f851-4c11-b967-5df8b2b4c1c9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] HTTP exception thrown: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c9c5ed2d-f851-4c11-b967-5df8b2b4c1c9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Request method failure captured: May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 HTTP/1.1 May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRyMhclh6LTRwblp7zHoq2zzJB0ag7A3TRquCEH5wH8QtETFnS-6bTYxkZsQ9czSR0QQfd2iq_zHh1TvCm07_BEnMGXu547LuwkgH-vJId89D2nZrLhCblA3-vUdHZsv3paGRJqwfitHuuflyOUHmH0-XdqaOpJbeekEXxmyXomG6HA May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 38fdbe6cacb8487087950884b752b21d May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-AttachVolumeTestJSON-235399587 May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:46:40.126844 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:46:40.128541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_38fdbe6cacb8487087950884b752b21d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:46:40.128541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-AttachVolumeTestJSON-235399587 May 12 14:46:40.128541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 38fdbe6cacb8487087950884b752b21d May 12 14:46:40.128541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-AttachVolumeTestJSON-235399587 May 12 14:46:40.128541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-AttachVolumeTestJSON-235399587-project May 12 14:46:40.128541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:46:40.128541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:46:40.128541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: 5ea3990cf736495ea612f1f5ed4f8674 May 12 14:46:40.128541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-AttachVolumeTestJSON-235399587-project May 12 14:46:40.128541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:46:40.128541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. May 12 14:46:40.128541 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': 'b4b68e00-a067-4696-b0d5-2cc050569c72'} May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:46:40.130271 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. May 12 14:46:40.131897 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:46:40.133324 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c9c5ed2d-f851-4c11-b967-5df8b2b4c1c9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Returning 404 to user: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:46:40.133324 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c9c5ed2d-f851-4c11-b967-5df8b2b4c1c9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 404 len: 111 microversion: 2.1 time: 0.031637 May 12 14:46:40.133324 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 679/1373] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:46:40 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:46:40.138091 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a6fe6671-049c-4fce-b51d-e697f7b2ac91 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '.version_select at 0x7f5b26cac670>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:40.157523 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a6fe6671-049c-4fce-b51d-e697f7b2ac91 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984954472" status: 202 len: 0 microversion: 2.1 time: 0.023273 May 12 14:46:40.158077 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 695/1374] 10.222.0.75 () {58 vars in 1220 bytes} [Thu May 12 14:46:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984954472 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 14:46:40.787479 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-45704b3c-00aa-4ab0-bd03-950f0f768f85 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Action: 'create', calling method: .version_select at 0x7f5b262edee0>, body: {"keypair": {"name": "tempest-keypair-502224221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk0y+5+HwMnFokaWA2wgXYAhghPZosiH+m9QNzsRc+hw297/o9Yz5eUmGl0XxLl7WGv07kQZ5FnXSuZ5+0sFP/Nm6hUtwBDOyUDmzfu0hLJtAgAp40WLdv64ir2GyAnNA=="}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:46:40.801228 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-45704b3c-00aa-4ab0-bd03-950f0f768f85 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Getting quotas for project 38fdbe6cacb8487087950884b752b21d. Resources: {'key_pairs'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:46:40.805214 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.quota [None req-45704b3c-00aa-4ab0-bd03-950f0f768f85 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Getting quotas for user 5ea3990cf736495ea612f1f5ed4f8674 and project 38fdbe6cacb8487087950884b752b21d. Resources: {'key_pairs'} {{(pid=118216) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:46:40.833536 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-45704b3c-00aa-4ab0-bd03-950f0f768f85 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050123 May 12 14:46:40.834161 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 680/1375] 10.222.0.75 () {60 vars in 1158 bytes} [Thu May 12 14:46:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:42.067316 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-606639405", "imageRef": "7980ca40-17e9-441a-bc5e-d598b68ea108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6aa87a35-26a0-490d-b024-c2e7f7422864"}], "security_groups": [{"name": "tempest-securitygroup--1825693334"}], "key_name": "tempest-keypair-502224221", "user_data": "}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:46:42.166550 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.network.neutron [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] validate_networks() for [('6aa87a35-26a0-490d-b024-c2e7f7422864', None, None, None, None, None)] {{(pid=118217) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 14:46:42.520036 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Flavor limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:46:42.520467 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Image limits 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:46:42.521164 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Flavor pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:46:42.521646 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Image pref 0:0:0 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:46:42.522016 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.virt.hardware [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118217) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:46:42.534434 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:42.535140 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:42.536898 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:42.537571 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:42.560717 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Getting quotas for project 38fdbe6cacb8487087950884b752b21d. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 14:46:42.565900 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.quota [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Getting quotas for user 5ea3990cf736495ea612f1f5ed4f8674 and project 38fdbe6cacb8487087950884b752b21d. Resources: {'cores', 'instances', 'ram'} {{(pid=118217) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 14:46:42.579678 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Going to run 1 instances... {{(pid=118217) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 14:46:42.582232 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7980ca40-17e9-441a-bc5e-d598b68ea108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118217) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 14:46:42.637159 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-cf08aa4b-70d8-4778-ba24-4fa8be7f7431 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.574631 May 12 14:46:42.637802 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 696/1376] 10.222.0.75 () {60 vars in 1146 bytes} [Thu May 12 14:46:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:46:42.648199 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-498ba889-a0c7-4479-9afc-18b8e74ed3c3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:42.648817 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-498ba889-a0c7-4479-9afc-18b8e74ed3c3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:42.703251 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-498ba889-a0c7-4479-9afc-18b8e74ed3c3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:42.710533 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-498ba889-a0c7-4479-9afc-18b8e74ed3c3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 200 len: 1236 microversion: 2.1 time: 0.066785 May 12 14:46:42.711120 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 681/1377] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:46:42 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:43.727523 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-8e365c68-6050-4f81-9ef8-df590f0ebdc9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:43.728283 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-8e365c68-6050-4f81-9ef8-df590f0ebdc9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:43.734674 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8e365c68-6050-4f81-9ef8-df590f0ebdc9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:43.735161 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8e365c68-6050-4f81-9ef8-df590f0ebdc9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:43.735942 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8e365c68-6050-4f81-9ef8-df590f0ebdc9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:43.736381 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-8e365c68-6050-4f81-9ef8-df590f0ebdc9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:43.805218 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-8e365c68-6050-4f81-9ef8-df590f0ebdc9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:43.812386 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-8e365c68-6050-4f81-9ef8-df590f0ebdc9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 200 len: 1294 microversion: 2.1 time: 0.089327 May 12 14:46:43.812955 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 697/1378] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:46:43 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:44.829880 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-5f46e304-c397-4c6e-9487-bcf8d1b4f61c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:44.830498 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-5f46e304-c397-4c6e-9487-bcf8d1b4f61c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:44.837153 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5f46e304-c397-4c6e-9487-bcf8d1b4f61c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:44.837605 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5f46e304-c397-4c6e-9487-bcf8d1b4f61c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:44.838385 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5f46e304-c397-4c6e-9487-bcf8d1b4f61c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:44.838826 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-5f46e304-c397-4c6e-9487-bcf8d1b4f61c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:45.060568 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-5f46e304-c397-4c6e-9487-bcf8d1b4f61c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:45.068857 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-5f46e304-c397-4c6e-9487-bcf8d1b4f61c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 200 len: 1362 microversion: 2.1 time: 0.242848 May 12 14:46:45.070079 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 682/1379] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:46:44 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:45.197684 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-05756c92-ff08-4ff2-af43-fda5b4c0f257 req-799f5ec3-fba3-4dae-8882-62e756005b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37a3cee-b6bd-4e65-8157-83686885e6d9", "tag": "4e58062a-2dff-4198-a58d-76133aeb4be9"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:46:45.206935 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-05756c92-ff08-4ff2-af43-fda5b4c0f257 req-799f5ec3-fba3-4dae-8882-62e756005b34 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:45.207370 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-05756c92-ff08-4ff2-af43-fda5b4c0f257 req-799f5ec3-fba3-4dae-8882-62e756005b34 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:45.218665 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-05756c92-ff08-4ff2-af43-fda5b4c0f257 req-799f5ec3-fba3-4dae-8882-62e756005b34 service nova] Creating event network-changed:4e58062a-2dff-4198-a58d-76133aeb4be9 for instance f37a3cee-b6bd-4e65-8157-83686885e6d9 on hv-cinder-77703 May 12 14:46:45.223838 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-05756c92-ff08-4ff2-af43-fda5b4c0f257 req-799f5ec3-fba3-4dae-8882-62e756005b34 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035994 May 12 14:46:45.224708 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 698/1380] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:46.086634 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-8bdd9508-8c6f-4d96-a7eb-e92b3a5042d3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:46.087284 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-8bdd9508-8c6f-4d96-a7eb-e92b3a5042d3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:46.093741 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8bdd9508-8c6f-4d96-a7eb-e92b3a5042d3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:46.094204 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8bdd9508-8c6f-4d96-a7eb-e92b3a5042d3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:46.094982 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8bdd9508-8c6f-4d96-a7eb-e92b3a5042d3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:46.095527 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-8bdd9508-8c6f-4d96-a7eb-e92b3a5042d3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:46.223394 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-8bdd9508-8c6f-4d96-a7eb-e92b3a5042d3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:46.230588 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-8bdd9508-8c6f-4d96-a7eb-e92b3a5042d3 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 200 len: 1362 microversion: 2.1 time: 0.148343 May 12 14:46:46.231177 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 683/1381] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:46:46 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:47.249400 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bfffe1f2-1516-4341-986c-11f44840d924 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:47.250030 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bfffe1f2-1516-4341-986c-11f44840d924 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:47.257040 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bfffe1f2-1516-4341-986c-11f44840d924 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:47.257492 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bfffe1f2-1516-4341-986c-11f44840d924 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:47.258268 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bfffe1f2-1516-4341-986c-11f44840d924 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:47.258707 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bfffe1f2-1516-4341-986c-11f44840d924 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:47.384111 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bfffe1f2-1516-4341-986c-11f44840d924 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:47.391336 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bfffe1f2-1516-4341-986c-11f44840d924 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 200 len: 1362 microversion: 2.1 time: 0.146749 May 12 14:46:47.391908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 699/1382] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:46:47 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:48.407362 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-79017bef-99c3-42c0-9c1e-c8cd08d2d7ba tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:48.408004 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-79017bef-99c3-42c0-9c1e-c8cd08d2d7ba tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:48.414372 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-79017bef-99c3-42c0-9c1e-c8cd08d2d7ba tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:48.414817 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-79017bef-99c3-42c0-9c1e-c8cd08d2d7ba tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:48.415610 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-79017bef-99c3-42c0-9c1e-c8cd08d2d7ba tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:48.416041 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-79017bef-99c3-42c0-9c1e-c8cd08d2d7ba tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:48.539726 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-79017bef-99c3-42c0-9c1e-c8cd08d2d7ba tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:48.546856 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-79017bef-99c3-42c0-9c1e-c8cd08d2d7ba tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 200 len: 1362 microversion: 2.1 time: 0.143421 May 12 14:46:48.547465 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 684/1383] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:46:48 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:49.563821 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-5b5d20a2-ce72-4e9f-b506-1ab3f657450b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:49.564473 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-5b5d20a2-ce72-4e9f-b506-1ab3f657450b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:49.571388 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5b5d20a2-ce72-4e9f-b506-1ab3f657450b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:49.571841 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5b5d20a2-ce72-4e9f-b506-1ab3f657450b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:49.572614 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5b5d20a2-ce72-4e9f-b506-1ab3f657450b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:49.573053 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-5b5d20a2-ce72-4e9f-b506-1ab3f657450b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:49.700988 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-5b5d20a2-ce72-4e9f-b506-1ab3f657450b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:49.708237 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-5b5d20a2-ce72-4e9f-b506-1ab3f657450b tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 200 len: 1362 microversion: 2.1 time: 0.148317 May 12 14:46:49.708808 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 700/1384] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:46:49 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:50.724807 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-915f164b-c227-482d-b921-2a4b5c252bf2 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:50.725531 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-915f164b-c227-482d-b921-2a4b5c252bf2 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:50.731936 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-915f164b-c227-482d-b921-2a4b5c252bf2 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:50.732396 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-915f164b-c227-482d-b921-2a4b5c252bf2 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:50.733174 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-915f164b-c227-482d-b921-2a4b5c252bf2 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:50.733614 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-915f164b-c227-482d-b921-2a4b5c252bf2 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:50.860611 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-915f164b-c227-482d-b921-2a4b5c252bf2 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:50.867895 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-915f164b-c227-482d-b921-2a4b5c252bf2 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 200 len: 1362 microversion: 2.1 time: 0.146931 May 12 14:46:50.868734 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 685/1385] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:46:50 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:51.532390 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-cb77c317-a525-4271-b66e-ad7035bfb0f1 req-8956da13-b1a2-4b6d-acb5-172202f1d8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37a3cee-b6bd-4e65-8157-83686885e6d9", "name": "network-vif-plugged", "status": "completed", "tag": "4e58062a-2dff-4198-a58d-76133aeb4be9"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:46:51.540605 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-cb77c317-a525-4271-b66e-ad7035bfb0f1 req-8956da13-b1a2-4b6d-acb5-172202f1d8e6 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:51.541050 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-cb77c317-a525-4271-b66e-ad7035bfb0f1 req-8956da13-b1a2-4b6d-acb5-172202f1d8e6 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:51.554091 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-cb77c317-a525-4271-b66e-ad7035bfb0f1 req-8956da13-b1a2-4b6d-acb5-172202f1d8e6 service nova] Creating event network-vif-plugged:4e58062a-2dff-4198-a58d-76133aeb4be9 for instance f37a3cee-b6bd-4e65-8157-83686885e6d9 on hv-cinder-77703 May 12 14:46:51.559441 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-cb77c317-a525-4271-b66e-ad7035bfb0f1 req-8956da13-b1a2-4b6d-acb5-172202f1d8e6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030563 May 12 14:46:51.560943 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 701/1386] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:46:51.884637 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-ba569553-2ea0-4e38-893e-bf2b0a66e299 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:51.885185 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-ba569553-2ea0-4e38-893e-bf2b0a66e299 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:51.891492 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ba569553-2ea0-4e38-893e-bf2b0a66e299 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:51.891951 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ba569553-2ea0-4e38-893e-bf2b0a66e299 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:51.892728 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ba569553-2ea0-4e38-893e-bf2b0a66e299 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:51.893174 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-ba569553-2ea0-4e38-893e-bf2b0a66e299 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:52.018398 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-ba569553-2ea0-4e38-893e-bf2b0a66e299 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:52.025884 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-ba569553-2ea0-4e38-893e-bf2b0a66e299 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 200 len: 1362 microversion: 2.1 time: 0.145219 May 12 14:46:52.026447 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 686/1387] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:46:51 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:53.043275 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-1db201e6-5fb7-4ba5-8ea0-b947cb690740 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:53.043977 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-1db201e6-5fb7-4ba5-8ea0-b947cb690740 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:53.050438 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1db201e6-5fb7-4ba5-8ea0-b947cb690740 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:53.050890 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1db201e6-5fb7-4ba5-8ea0-b947cb690740 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:53.051680 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1db201e6-5fb7-4ba5-8ea0-b947cb690740 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:53.052120 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-1db201e6-5fb7-4ba5-8ea0-b947cb690740 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:53.180903 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-1db201e6-5fb7-4ba5-8ea0-b947cb690740 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:53.188515 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-1db201e6-5fb7-4ba5-8ea0-b947cb690740 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 200 len: 1362 microversion: 2.1 time: 0.149473 May 12 14:46:53.189104 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 702/1388] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:46:53 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:54.205971 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e7bca13b-d744-41b9-9ee2-b3a59381c780 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:54.206591 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e7bca13b-d744-41b9-9ee2-b3a59381c780 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:54.213500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7bca13b-d744-41b9-9ee2-b3a59381c780 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:54.213949 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7bca13b-d744-41b9-9ee2-b3a59381c780 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:54.214769 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7bca13b-d744-41b9-9ee2-b3a59381c780 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:54.215199 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e7bca13b-d744-41b9-9ee2-b3a59381c780 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:54.614001 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-e7bca13b-d744-41b9-9ee2-b3a59381c780 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:46:54.621650 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e7bca13b-d744-41b9-9ee2-b3a59381c780 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 200 len: 1547 microversion: 2.1 time: 0.419600 May 12 14:46:54.622222 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 687/1389] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:46:54 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 1547 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:46:54.638134 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-4c494a88-9eae-4d09-a450-a5f20f65a241 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:54.638664 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-4c494a88-9eae-4d09-a450-a5f20f65a241 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:46:54.645494 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4c494a88-9eae-4d09-a450-a5f20f65a241 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:54.645960 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4c494a88-9eae-4d09-a450-a5f20f65a241 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:54.646728 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4c494a88-9eae-4d09-a450-a5f20f65a241 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:54.647198 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-4c494a88-9eae-4d09-a450-a5f20f65a241 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:54.722066 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-4c494a88-9eae-4d09-a450-a5f20f65a241 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087625 May 12 14:46:54.722663 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 703/1390] 10.222.0.75 () {58 vars in 1274 bytes} [Thu May 12 14:46:54 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:55.686615 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [req-5fa74272-41b9-4a8f-b7ea-9dc00957bd2a req-d8c56903-4fc5-4b3b-b428-105b605d217c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37a3cee-b6bd-4e65-8157-83686885e6d9", "tag": "4e58062a-2dff-4198-a58d-76133aeb4be9"}]} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:46:55.696137 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-5fa74272-41b9-4a8f-b7ea-9dc00957bd2a req-d8c56903-4fc5-4b3b-b428-105b605d217c service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:46:55.696670 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [req-5fa74272-41b9-4a8f-b7ea-9dc00957bd2a req-d8c56903-4fc5-4b3b-b428-105b605d217c service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:46:55.708180 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.compute.server_external_events [req-5fa74272-41b9-4a8f-b7ea-9dc00957bd2a req-d8c56903-4fc5-4b3b-b428-105b605d217c service nova] Creating event network-changed:4e58062a-2dff-4198-a58d-76133aeb4be9 for instance f37a3cee-b6bd-4e65-8157-83686885e6d9 on hv-cinder-77703 May 12 14:46:55.713641 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [req-5fa74272-41b9-4a8f-b7ea-9dc00957bd2a req-d8c56903-4fc5-4b3b-b428-105b605d217c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031433 May 12 14:46:55.714751 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 688/1391] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:11.028787 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-6d837026-a242-4442-9ff4-d4345e533bfb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:11.029375 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-6d837026-a242-4442-9ff4-d4345e533bfb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:11.035256 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6d837026-a242-4442-9ff4-d4345e533bfb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:11.035718 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6d837026-a242-4442-9ff4-d4345e533bfb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:11.036493 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6d837026-a242-4442-9ff4-d4345e533bfb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:11.036937 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-6d837026-a242-4442-9ff4-d4345e533bfb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:11.061564 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-6d837026-a242-4442-9ff4-d4345e533bfb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/ips" status: 200 len: 144 microversion: 2.1 time: 0.038169 May 12 14:48:11.062130 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 704/1392] 10.222.0.75 () {58 vars in 1247 bytes} [Thu May 12 14:48:11 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:12.371328 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-e8351c12-4051-489f-881a-fefeb2558c2c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b786b69a-4783-42b6-bfc7-5effe0be3633"}} {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:12.372471 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-e8351c12-4051-489f-881a-fefeb2558c2c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:12.378608 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e8351c12-4051-489f-881a-fefeb2558c2c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:12.379078 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e8351c12-4051-489f-881a-fefeb2558c2c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:12.379845 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e8351c12-4051-489f-881a-fefeb2558c2c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:12.380278 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-e8351c12-4051-489f-881a-fefeb2558c2c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:12.632211 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-e8351c12-4051-489f-881a-fefeb2558c2c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "POST /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266786 May 12 14:48:12.632870 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 689/1393] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 12 14:48:12 2022] POST /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:20.107811 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c458119e-f45b-429b-b1b2-48e6982a55ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:20.108736 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c458119e-f45b-429b-b1b2-48e6982a55ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:20.114581 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c458119e-f45b-429b-b1b2-48e6982a55ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:20.115058 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c458119e-f45b-429b-b1b2-48e6982a55ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:20.115820 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c458119e-f45b-429b-b1b2-48e6982a55ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:20.116258 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c458119e-f45b-429b-b1b2-48e6982a55ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:20.144159 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c458119e-f45b-429b-b1b2-48e6982a55ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041110 May 12 14:48:20.144706 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 705/1394] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:48:20 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:20.155937 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-2bbb74e7-099e-401c-9b58-e99ce3745c65 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:20.156528 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-2bbb74e7-099e-401c-9b58-e99ce3745c65 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:20.162771 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2bbb74e7-099e-401c-9b58-e99ce3745c65 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:20.163263 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2bbb74e7-099e-401c-9b58-e99ce3745c65 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:20.164041 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2bbb74e7-099e-401c-9b58-e99ce3745c65 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:20.164483 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-2bbb74e7-099e-401c-9b58-e99ce3745c65 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:20.192428 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-2bbb74e7-099e-401c-9b58-e99ce3745c65 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments/b786b69a-4783-42b6-bfc7-5effe0be3633" status: 200 len: 194 microversion: 2.1 time: 0.041328 May 12 14:48:20.192998 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 690/1395] 10.222.0.75 () {58 vars in 1412 bytes} [Thu May 12 14:48:20 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments/b786b69a-4783-42b6-bfc7-5effe0be3633 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:21.492378 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-9b6fc647-992e-4085-a030-8306c686a7c5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cde0c15-c3f2-4565-811a-829087ec4221"}} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:21.493727 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-9b6fc647-992e-4085-a030-8306c686a7c5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:21.500062 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9b6fc647-992e-4085-a030-8306c686a7c5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:21.500522 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9b6fc647-992e-4085-a030-8306c686a7c5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:21.501288 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9b6fc647-992e-4085-a030-8306c686a7c5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:21.501729 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-9b6fc647-992e-4085-a030-8306c686a7c5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:21.747546 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-9b6fc647-992e-4085-a030-8306c686a7c5 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "POST /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258884 May 12 14:48:21.753102 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 706/1396] 10.222.0.75 () {60 vars in 1322 bytes} [Thu May 12 14:48:21 2022] POST /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:29.218643 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-64cbc923-96c3-465e-a775-876e87c4d82a tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:29.219598 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-64cbc923-96c3-465e-a775-876e87c4d82a tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:29.225774 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-64cbc923-96c3-465e-a775-876e87c4d82a tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:29.226232 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-64cbc923-96c3-465e-a775-876e87c4d82a tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:29.226996 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-64cbc923-96c3-465e-a775-876e87c4d82a tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:29.227465 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-64cbc923-96c3-465e-a775-876e87c4d82a tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:29.256502 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-64cbc923-96c3-465e-a775-876e87c4d82a tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041781 May 12 14:48:29.257057 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 691/1397] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:48:29 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:48:29.402523 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-3a1fc3c1-79b0-459c-ba5c-a8b359a8d534 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:29.403234 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-3a1fc3c1-79b0-459c-ba5c-a8b359a8d534 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:29.409251 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3a1fc3c1-79b0-459c-ba5c-a8b359a8d534 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:29.409705 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3a1fc3c1-79b0-459c-ba5c-a8b359a8d534 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:29.410475 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3a1fc3c1-79b0-459c-ba5c-a8b359a8d534 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:29.410908 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-3a1fc3c1-79b0-459c-ba5c-a8b359a8d534 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:29.448757 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-3a1fc3c1-79b0-459c-ba5c-a8b359a8d534 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments/b786b69a-4783-42b6-bfc7-5effe0be3633" status: 200 len: 194 microversion: 2.1 time: 0.051138 May 12 14:48:29.449350 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 707/1398] 10.222.0.75 () {58 vars in 1412 bytes} [Thu May 12 14:48:29 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments/b786b69a-4783-42b6-bfc7-5effe0be3633 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:29.458914 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-06c0ad8e-dad3-4670-8380-db38cdf6e230 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:29.459437 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-06c0ad8e-dad3-4670-8380-db38cdf6e230 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:29.466132 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-06c0ad8e-dad3-4670-8380-db38cdf6e230 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:29.466589 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-06c0ad8e-dad3-4670-8380-db38cdf6e230 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:29.467394 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-06c0ad8e-dad3-4670-8380-db38cdf6e230 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:29.468329 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-06c0ad8e-dad3-4670-8380-db38cdf6e230 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:29.549142 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-06c0ad8e-dad3-4670-8380-db38cdf6e230 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lazy-loading 'services' on Instance uuid f37a3cee-b6bd-4e65-8157-83686885e6d9 {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:48:29.618166 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-06c0ad8e-dad3-4670-8380-db38cdf6e230 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments/b786b69a-4783-42b6-bfc7-5effe0be3633" status: 202 len: 0 microversion: 2.1 time: 0.162738 May 12 14:48:29.618789 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 692/1399] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 12 14:48:29 2022] DELETE /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments/b786b69a-4783-42b6-bfc7-5effe0be3633 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 14:48:30.728285 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-2889da7c-f2ef-461c-a66a-a23d9eb439ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:30.729352 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-2889da7c-f2ef-461c-a66a-a23d9eb439ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:30.736687 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2889da7c-f2ef-461c-a66a-a23d9eb439ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:30.737150 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2889da7c-f2ef-461c-a66a-a23d9eb439ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:30.737939 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2889da7c-f2ef-461c-a66a-a23d9eb439ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:30.738480 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-2889da7c-f2ef-461c-a66a-a23d9eb439ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:30.769718 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-2889da7c-f2ef-461c-a66a-a23d9eb439ae tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments/7cde0c15-c3f2-4565-811a-829087ec4221" status: 200 len: 194 microversion: 2.1 time: 0.045441 May 12 14:48:30.774735 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 708/1400] 10.222.0.75 () {58 vars in 1412 bytes} [Thu May 12 14:48:30 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments/7cde0c15-c3f2-4565-811a-829087ec4221 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:30.781206 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-614c3d5d-6724-48dc-ad77-b222982f64af tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:30.781918 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-614c3d5d-6724-48dc-ad77-b222982f64af tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:30.788489 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-614c3d5d-6724-48dc-ad77-b222982f64af tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:30.788938 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-614c3d5d-6724-48dc-ad77-b222982f64af tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:30.789705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-614c3d5d-6724-48dc-ad77-b222982f64af tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:30.790140 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-614c3d5d-6724-48dc-ad77-b222982f64af tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:30.866895 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-614c3d5d-6724-48dc-ad77-b222982f64af tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lazy-loading 'services' on Instance uuid f37a3cee-b6bd-4e65-8157-83686885e6d9 {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:48:30.933928 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-614c3d5d-6724-48dc-ad77-b222982f64af tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments/7cde0c15-c3f2-4565-811a-829087ec4221" status: 202 len: 0 microversion: 2.1 time: 0.156857 May 12 14:48:30.934548 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 693/1401] 10.222.0.75 () {58 vars in 1415 bytes} [Thu May 12 14:48:30 2022] DELETE /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments/7cde0c15-c3f2-4565-811a-829087ec4221 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:48:32.087391 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-96695601-8b2e-4830-af0b-8c5745e0da33 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:32.088321 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-96695601-8b2e-4830-af0b-8c5745e0da33 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:32.095140 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-96695601-8b2e-4830-af0b-8c5745e0da33 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:32.095596 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-96695601-8b2e-4830-af0b-8c5745e0da33 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:32.096359 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-96695601-8b2e-4830-af0b-8c5745e0da33 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:32.096792 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-96695601-8b2e-4830-af0b-8c5745e0da33 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:32.124706 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-96695601-8b2e-4830-af0b-8c5745e0da33 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041232 May 12 14:48:32.125268 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 709/1402] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:48:32 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:48:32.235533 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-d77c5b6a-d2c8-48dd-be76-604d36d0b5cb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:32.236608 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-d77c5b6a-d2c8-48dd-be76-604d36d0b5cb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:32.242894 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d77c5b6a-d2c8-48dd-be76-604d36d0b5cb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:32.243390 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d77c5b6a-d2c8-48dd-be76-604d36d0b5cb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:32.244170 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d77c5b6a-d2c8-48dd-be76-604d36d0b5cb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:32.244613 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-d77c5b6a-d2c8-48dd-be76-604d36d0b5cb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:32.272746 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-d77c5b6a-d2c8-48dd-be76-604d36d0b5cb tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041922 May 12 14:48:32.273238 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 694/1403] 10.222.0.75 () {58 vars in 1301 bytes} [Thu May 12 14:48:32 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:48:32.327808 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c061a851-6a3b-4877-820c-0f8981fc99a9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:32.328306 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c061a851-6a3b-4877-820c-0f8981fc99a9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:32.334707 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c061a851-6a3b-4877-820c-0f8981fc99a9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:32.335188 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c061a851-6a3b-4877-820c-0f8981fc99a9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:32.335948 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c061a851-6a3b-4877-820c-0f8981fc99a9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:32.336380 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c061a851-6a3b-4877-820c-0f8981fc99a9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:32.361059 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c061a851-6a3b-4877-820c-0f8981fc99a9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Going to try to terminate instance {{(pid=118217) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 14:48:32.433995 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c061a851-6a3b-4877-820c-0f8981fc99a9 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 204 len: 0 microversion: 2.1 time: 0.109696 May 12 14:48:32.434585 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 710/1404] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:48:32 2022] DELETE /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:48:32.443942 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c89c96b4-5fce-4a49-81f9-95ba169315a0 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:32.444552 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c89c96b4-5fce-4a49-81f9-95ba169315a0 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:32.450572 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c89c96b4-5fce-4a49-81f9-95ba169315a0 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:32.451049 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c89c96b4-5fce-4a49-81f9-95ba169315a0 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:32.451827 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c89c96b4-5fce-4a49-81f9-95ba169315a0 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:32.452268 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c89c96b4-5fce-4a49-81f9-95ba169315a0 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:32.579913 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-c89c96b4-5fce-4a49-81f9-95ba169315a0 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:32.587156 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c89c96b4-5fce-4a49-81f9-95ba169315a0 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 200 len: 1671 microversion: 2.1 time: 0.146949 May 12 14:48:32.587728 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 695/1405] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:48:32 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 1671 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:33.605760 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-bc7b929e-1050-40ca-8b34-9bc5e8b11a30 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:33.606615 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-bc7b929e-1050-40ca-8b34-9bc5e8b11a30 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:33.612976 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bc7b929e-1050-40ca-8b34-9bc5e8b11a30 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:33.613432 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bc7b929e-1050-40ca-8b34-9bc5e8b11a30 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:33.614205 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bc7b929e-1050-40ca-8b34-9bc5e8b11a30 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:33.614649 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-bc7b929e-1050-40ca-8b34-9bc5e8b11a30 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:33.744586 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.policy [None req-bc7b929e-1050-40ca-8b34-9bc5e8b11a30 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118217) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:33.752581 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-bc7b929e-1050-40ca-8b34-9bc5e8b11a30 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 200 len: 1671 microversion: 2.1 time: 0.151668 May 12 14:48:33.753156 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 711/1406] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:48:33 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:34.773705 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-1ad6a475-35d0-4b35-ac83-42993f87eaaf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:34.774339 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-1ad6a475-35d0-4b35-ac83-42993f87eaaf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:34.780635 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ad6a475-35d0-4b35-ac83-42993f87eaaf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:34.781088 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ad6a475-35d0-4b35-ac83-42993f87eaaf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:34.781943 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ad6a475-35d0-4b35-ac83-42993f87eaaf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:34.782447 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-1ad6a475-35d0-4b35-ac83-42993f87eaaf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:34.993954 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-1ad6a475-35d0-4b35-ac83-42993f87eaaf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:35.002158 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-1ad6a475-35d0-4b35-ac83-42993f87eaaf tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 200 len: 1671 microversion: 2.1 time: 0.232260 May 12 14:48:35.003021 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 696/1407] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:48:34 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 1671 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:48:35.627344 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [req-c3ee38d7-6519-448a-8386-4fe2a97e70e6 req-52b5d7e9-6a52-4e80-85b0-fce3411bb332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37a3cee-b6bd-4e65-8157-83686885e6d9", "name": "network-vif-deleted", "tag": "4e58062a-2dff-4198-a58d-76133aeb4be9"}]} {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:35.637064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-c3ee38d7-6519-448a-8386-4fe2a97e70e6 req-52b5d7e9-6a52-4e80-85b0-fce3411bb332 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:35.637518 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [req-c3ee38d7-6519-448a-8386-4fe2a97e70e6 req-52b5d7e9-6a52-4e80-85b0-fce3411bb332 service nova] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:35.664481 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.compute.server_external_events [req-c3ee38d7-6519-448a-8386-4fe2a97e70e6 req-52b5d7e9-6a52-4e80-85b0-fce3411bb332 service nova] Creating event network-vif-deleted:4e58062a-2dff-4198-a58d-76133aeb4be9 for instance f37a3cee-b6bd-4e65-8157-83686885e6d9 on hv-cinder-77703 May 12 14:48:35.670316 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [req-c3ee38d7-6519-448a-8386-4fe2a97e70e6 req-52b5d7e9-6a52-4e80-85b0-fce3411bb332 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111392 May 12 14:48:35.671526 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 712/1408] 10.222.0.75 () {64 vars in 1317 bytes} [Thu May 12 14:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:36.021027 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-548759e6-acd5-449e-acc9-1268e947f66c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:36.021569 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-548759e6-acd5-449e-acc9-1268e947f66c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:36.029074 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-548759e6-acd5-449e-acc9-1268e947f66c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:36.029533 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-548759e6-acd5-449e-acc9-1268e947f66c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:36.030328 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-548759e6-acd5-449e-acc9-1268e947f66c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:36.030770 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-548759e6-acd5-449e-acc9-1268e947f66c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:36.061763 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-548759e6-acd5-449e-acc9-1268e947f66c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:36.062218 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-548759e6-acd5-449e-acc9-1268e947f66c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:36.062679 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.objects.instance [None req-548759e6-acd5-449e-acc9-1268e947f66c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lazy-loading 'fault' on Instance uuid f37a3cee-b6bd-4e65-8157-83686885e6d9 {{(pid=118216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 14:48:36.107163 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.policy [None req-548759e6-acd5-449e-acc9-1268e947f66c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea3990cf736495ea612f1f5ed4f8674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38fdbe6cacb8487087950884b752b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118216) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:36.115087 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-548759e6-acd5-449e-acc9-1268e947f66c tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 200 len: 1326 microversion: 2.1 time: 0.099040 May 12 14:48:36.116042 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 697/1409] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:48:36 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:48:37.133655 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a02c5c7c-1f9c-4c2c-a396-25d0bec700be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:37.134386 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-a02c5c7c-1f9c-4c2c-a396-25d0bec700be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:37.140555 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a02c5c7c-1f9c-4c2c-a396-25d0bec700be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:37.141006 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a02c5c7c-1f9c-4c2c-a396-25d0bec700be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:37.141769 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a02c5c7c-1f9c-4c2c-a396-25d0bec700be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:37.142205 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-a02c5c7c-1f9c-4c2c-a396-25d0bec700be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:37.156744 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-a02c5c7c-1f9c-4c2c-a396-25d0bec700be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] HTTP exception thrown: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a02c5c7c-1f9c-4c2c-a396-25d0bec700be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Request method failure captured: May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 HTTP/1.1 May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRyMhclh6LTRwblp7zHoq2zzJB0ag7A3TRquCEH5wH8QtETFnS-6bTYxkZsQ9czSR0QQfd2iq_zHh1TvCm07_BEnMGXu547LuwkgH-vJId89D2nZrLhCblA3-vUdHZsv3paGRJqwfitHuuflyOUHmH0-XdqaOpJbeekEXxmyXomG6HA May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 38fdbe6cacb8487087950884b752b21d May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-AttachVolumeTestJSON-235399587 May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:48:37.158349 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:48:37.160301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_38fdbe6cacb8487087950884b752b21d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:48:37.160301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-AttachVolumeTestJSON-235399587 May 12 14:48:37.160301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 38fdbe6cacb8487087950884b752b21d May 12 14:48:37.160301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-AttachVolumeTestJSON-235399587 May 12 14:48:37.160301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-AttachVolumeTestJSON-235399587-project May 12 14:48:37.160301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:48:37.160301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:48:37.160301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: 5ea3990cf736495ea612f1f5ed4f8674 May 12 14:48:37.160301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-AttachVolumeTestJSON-235399587-project May 12 14:48:37.160301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:48:37.160301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. May 12 14:48:37.160301 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': 'f37a3cee-b6bd-4e65-8157-83686885e6d9'} May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:37.161489 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. May 12 14:48:37.163282 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:48:37.164821 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-a02c5c7c-1f9c-4c2c-a396-25d0bec700be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Returning 404 to user: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:37.164821 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-a02c5c7c-1f9c-4c2c-a396-25d0bec700be tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 404 len: 111 microversion: 2.1 time: 0.030878 May 12 14:48:37.164821 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 713/1410] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:48:37 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:48:37.169096 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-3f96a0a2-7fb2-4937-818a-5bf0f1ce1048 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '.version_select at 0x7f5b262e6040>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:37.186020 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-3f96a0a2-7fb2-4937-818a-5bf0f1ce1048 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-502224221" status: 202 len: 0 microversion: 2.1 time: 0.020969 May 12 14:48:37.186211 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 698/1411] 10.222.0.75 () {58 vars in 1217 bytes} [Thu May 12 14:48:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-502224221 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 14:48:40.033869 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c99fd3b1-55f7-405e-bcbc-f662809985fd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:40.034371 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-c99fd3b1-55f7-405e-bcbc-f662809985fd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:40.040964 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c99fd3b1-55f7-405e-bcbc-f662809985fd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:40.041445 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c99fd3b1-55f7-405e-bcbc-f662809985fd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:40.042220 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c99fd3b1-55f7-405e-bcbc-f662809985fd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:40.042662 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-c99fd3b1-55f7-405e-bcbc-f662809985fd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:40.056793 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-c99fd3b1-55f7-405e-bcbc-f662809985fd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] HTTP exception thrown: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c99fd3b1-55f7-405e-bcbc-f662809985fd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Request method failure captured: May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: DELETE /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 HTTP/1.1 May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRyMhclh6LTRwblp7zHoq2zzJB0ag7A3TRquCEH5wH8QtETFnS-6bTYxkZsQ9czSR0QQfd2iq_zHh1TvCm07_BEnMGXu547LuwkgH-vJId89D2nZrLhCblA3-vUdHZsv3paGRJqwfitHuuflyOUHmH0-XdqaOpJbeekEXxmyXomG6HA May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 38fdbe6cacb8487087950884b752b21d May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-AttachVolumeTestJSON-235399587 May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:48:40.058340 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:48:40.060081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_38fdbe6cacb8487087950884b752b21d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:48:40.060081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-AttachVolumeTestJSON-235399587 May 12 14:48:40.060081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 38fdbe6cacb8487087950884b752b21d May 12 14:48:40.060081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-AttachVolumeTestJSON-235399587 May 12 14:48:40.060081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-AttachVolumeTestJSON-235399587-project May 12 14:48:40.060081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:48:40.060081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:48:40.060081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: 5ea3990cf736495ea612f1f5ed4f8674 May 12 14:48:40.060081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-AttachVolumeTestJSON-235399587-project May 12 14:48:40.060081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:48:40.060081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. May 12 14:48:40.060081 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': 'f37a3cee-b6bd-4e65-8157-83686885e6d9'} May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:40.061064 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. May 12 14:48:40.062632 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:48:40.064686 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-c99fd3b1-55f7-405e-bcbc-f662809985fd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Returning 404 to user: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:40.064686 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-c99fd3b1-55f7-405e-bcbc-f662809985fd tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 404 len: 111 microversion: 2.1 time: 0.029784 May 12 14:48:40.064686 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 714/1412] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:48:40 2022] DELETE /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:48:40.068783 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c612db1b-49c0-4192-acf8-da7e5f19b1a1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:40.069430 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-c612db1b-49c0-4192-acf8-da7e5f19b1a1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: f37a3cee-b6bd-4e65-8157-83686885e6d9] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:40.075906 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c612db1b-49c0-4192-acf8-da7e5f19b1a1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:40.076372 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c612db1b-49c0-4192-acf8-da7e5f19b1a1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:40.077141 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c612db1b-49c0-4192-acf8-da7e5f19b1a1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:40.077579 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-c612db1b-49c0-4192-acf8-da7e5f19b1a1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:40.090145 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-c612db1b-49c0-4192-acf8-da7e5f19b1a1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] HTTP exception thrown: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c612db1b-49c0-4192-acf8-da7e5f19b1a1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Request method failure captured: May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 HTTP/1.1 May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRyMhclh6LTRwblp7zHoq2zzJB0ag7A3TRquCEH5wH8QtETFnS-6bTYxkZsQ9czSR0QQfd2iq_zHh1TvCm07_BEnMGXu547LuwkgH-vJId89D2nZrLhCblA3-vUdHZsv3paGRJqwfitHuuflyOUHmH0-XdqaOpJbeekEXxmyXomG6HA May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 38fdbe6cacb8487087950884b752b21d May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-AttachVolumeTestJSON-235399587 May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:48:40.092292 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:48:40.093994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_38fdbe6cacb8487087950884b752b21d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:48:40.093994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-AttachVolumeTestJSON-235399587 May 12 14:48:40.093994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 38fdbe6cacb8487087950884b752b21d May 12 14:48:40.093994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-AttachVolumeTestJSON-235399587 May 12 14:48:40.093994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-AttachVolumeTestJSON-235399587-project May 12 14:48:40.093994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:48:40.093994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:48:40.093994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: 5ea3990cf736495ea612f1f5ed4f8674 May 12 14:48:40.093994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-AttachVolumeTestJSON-235399587-project May 12 14:48:40.093994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:48:40.093994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. May 12 14:48:40.093994 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': 'f37a3cee-b6bd-4e65-8157-83686885e6d9'} May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:40.095103 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. May 12 14:48:40.096790 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:48:40.098225 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-c612db1b-49c0-4192-acf8-da7e5f19b1a1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Returning 404 to user: Instance f37a3cee-b6bd-4e65-8157-83686885e6d9 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:40.098225 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-c612db1b-49c0-4192-acf8-da7e5f19b1a1 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9" status: 404 len: 111 microversion: 2.1 time: 0.029290 May 12 14:48:40.098225 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 699/1413] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:48:40 2022] GET /compute/v2.1/servers/f37a3cee-b6bd-4e65-8157-83686885e6d9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:48:41.223401 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-64e8349c-4482-4a4d-92ca-c554073e9a77 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:41.223898 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.compute.api [None req-64e8349c-4482-4a4d-92ca-c554073e9a77 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118217) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:41.230167 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-64e8349c-4482-4a4d-92ca-c554073e9a77 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:41.230624 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-64e8349c-4482-4a4d-92ca-c554073e9a77 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:41.231449 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-64e8349c-4482-4a4d-92ca-c554073e9a77 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:41.231854 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG oslo_concurrency.lockutils [None req-64e8349c-4482-4a4d-92ca-c554073e9a77 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118217) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:41.245247 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.wsgi [None req-64e8349c-4482-4a4d-92ca-c554073e9a77 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] HTTP exception thrown: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-64e8349c-4482-4a4d-92ca-c554073e9a77 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Request method failure captured: May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: request: DELETE /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 HTTP/1.1 May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept: application/json May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Accept-Encoding: identity May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Connection: close May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Length: 0 May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Content-Type: application/json May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Host: 10.222.0.75 May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Openstack-System-Scope: None May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: User-Agent: python-urllib3/1.26.9 May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Auth-Token: gAAAAABifRyMhclh6LTRwblp7zHoq2zzJB0ag7A3TRquCEH5wH8QtETFnS-6bTYxkZsQ9czSR0QQfd2iq_zHh1TvCm07_BEnMGXu547LuwkgH-vJId89D2nZrLhCblA3-vUdHZsv3paGRJqwfitHuuflyOUHmH0-XdqaOpJbeekEXxmyXomG6HA May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Id: None May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Domain-Name: None May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Identity-Status: Confirmed May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Is-Admin-Project: True May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Id: default May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Domain-Name: Default May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Id: 38fdbe6cacb8487087950884b752b21d May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Project-Name: tempest-AttachVolumeTestJSON-235399587 May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Role: reader,member May 12 14:48:41.246784 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Roles: reader,member May 12 14:48:41.248629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_38fdbe6cacb8487087950884b752b21d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:48:41.248629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant: tempest-AttachVolumeTestJSON-235399587 May 12 14:48:41.248629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Id: 38fdbe6cacb8487087950884b752b21d May 12 14:48:41.248629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-Tenant-Name: tempest-AttachVolumeTestJSON-235399587 May 12 14:48:41.248629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User: tempest-AttachVolumeTestJSON-235399587-project May 12 14:48:41.248629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Id: default May 12 14:48:41.248629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Domain-Name: Default May 12 14:48:41.248629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Id: 5ea3990cf736495ea612f1f5ed4f8674 May 12 14:48:41.248629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: X-User-Name: tempest-AttachVolumeTestJSON-235399587-project May 12 14:48:41.248629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: method: > May 12 14:48:41.248629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: exception: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. May 12 14:48:41.248629 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: action_args: {'id': 'b4b68e00-a067-4696-b0d5-2cc050569c72'} May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: {{(pid=118217) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:41.249803 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. May 12 14:48:41.251658 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: ERROR nova.api.openstack.wsgi May 12 14:48:41.253299 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: DEBUG nova.api.openstack.wsgi [None req-64e8349c-4482-4a4d-92ca-c554073e9a77 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Returning 404 to user: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. {{(pid=118217) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:41.253299 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO nova.api.openstack.requestlog [None req-64e8349c-4482-4a4d-92ca-c554073e9a77 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 404 len: 111 microversion: 2.1 time: 0.028754 May 12 14:48:41.253299 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: [pid: 118217|app: 0|req: 715/1414] 10.222.0.75 () {58 vars in 1238 bytes} [Thu May 12 14:48:41 2022] DELETE /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:48:41.257683 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b564f530-dae1-461f-8795-e85d9ae35113 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Calling method '>' {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:41.258331 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.compute.api [None req-b564f530-dae1-461f-8795-e85d9ae35113 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] [instance: b4b68e00-a067-4696-b0d5-2cc050569c72] Fetching instance by UUID {{(pid=118216) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 14:48:41.265185 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b564f530-dae1-461f-8795-e85d9ae35113 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:41.265634 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b564f530-dae1-461f-8795-e85d9ae35113 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:41.266428 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b564f530-dae1-461f-8795-e85d9ae35113 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 14:48:41.266872 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG oslo_concurrency.lockutils [None req-b564f530-dae1-461f-8795-e85d9ae35113 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Lock "9c0b44fa-5cb1-4cc9-b975-38d3ec19564b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 14:48:41.281957 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.wsgi [None req-b564f530-dae1-461f-8795-e85d9ae35113 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] HTTP exception thrown: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b564f530-dae1-461f-8795-e85d9ae35113 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Request method failure captured: May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: request: GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 HTTP/1.1 May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept: application/json May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Accept-Encoding: identity May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Connection: close May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Length: 0 May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Content-Type: application/json May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Host: 10.222.0.75 May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Openstack-System-Scope: None May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: User-Agent: python-urllib3/1.26.9 May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Auth-Token: gAAAAABifRyMhclh6LTRwblp7zHoq2zzJB0ag7A3TRquCEH5wH8QtETFnS-6bTYxkZsQ9czSR0QQfd2iq_zHh1TvCm07_BEnMGXu547LuwkgH-vJId89D2nZrLhCblA3-vUdHZsv3paGRJqwfitHuuflyOUHmH0-XdqaOpJbeekEXxmyXomG6HA May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Id: None May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Domain-Name: None May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Identity-Status: Confirmed May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Is-Admin-Project: True May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Id: default May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Domain-Name: Default May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Id: 38fdbe6cacb8487087950884b752b21d May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Project-Name: tempest-AttachVolumeTestJSON-235399587 May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Role: reader,member May 12 14:48:41.283500 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Roles: reader,member May 12 14:48:41.285162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:8080/v1/AUTH_38fdbe6cacb8487087950884b752b21d", "adminURL": "http://10.222.0.75:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/38fdbe6cacb8487087950884b752b21d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}] May 12 14:48:41.285162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant: tempest-AttachVolumeTestJSON-235399587 May 12 14:48:41.285162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Id: 38fdbe6cacb8487087950884b752b21d May 12 14:48:41.285162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-Tenant-Name: tempest-AttachVolumeTestJSON-235399587 May 12 14:48:41.285162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User: tempest-AttachVolumeTestJSON-235399587-project May 12 14:48:41.285162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Id: default May 12 14:48:41.285162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Domain-Name: Default May 12 14:48:41.285162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Id: 5ea3990cf736495ea612f1f5ed4f8674 May 12 14:48:41.285162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: X-User-Name: tempest-AttachVolumeTestJSON-235399587-project May 12 14:48:41.285162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: method: > May 12 14:48:41.285162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: exception: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. May 12 14:48:41.285162 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: action_args: {'id': 'b4b68e00-a067-4696-b0d5-2cc050569c72'} May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: {{(pid=118216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 14:48:41.286371 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. May 12 14:48:41.287969 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: ERROR nova.api.openstack.wsgi May 12 14:48:41.289489 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: DEBUG nova.api.openstack.wsgi [None req-b564f530-dae1-461f-8795-e85d9ae35113 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] Returning 404 to user: Instance b4b68e00-a067-4696-b0d5-2cc050569c72 could not be found. {{(pid=118216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 14:48:41.289489 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO nova.api.openstack.requestlog [None req-b564f530-dae1-461f-8795-e85d9ae35113 tempest-AttachVolumeTestJSON-235399587 tempest-AttachVolumeTestJSON-235399587-project] 10.222.0.75 "GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72" status: 404 len: 111 microversion: 2.1 time: 0.031368 May 12 14:48:41.289489 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: [pid: 118216|app: 0|req: 700/1415] 10.222.0.75 () {58 vars in 1235 bytes} [Thu May 12 14:48:41 2022] GET /compute/v2.1/servers/b4b68e00-a067-4696-b0d5-2cc050569c72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:49:43.964122 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:49:43.964653 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Thu May 12 14:49:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:49:47.943119 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:49:47.943694 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Thu May 12 14:49:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:49:57.198463 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:49:57.198901 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Thu May 12 14:49:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:51:37.690444 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:51:37.691149 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Thu May 12 14:51:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:53:03.973257 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:53:03.973736 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Thu May 12 14:53:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:53:07.951733 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:53:07.952381 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Thu May 12 14:53:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:53:17.207667 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:53:17.208302 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Thu May 12 14:53:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:53:47.617986 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:53:47.618473 dv-cinder-777031-14-iscsi devstack@n-api.service[118217]: Thu May 12 14:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:54:47.577422 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:54:47.578070 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Thu May 12 14:54:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:54:57.698694 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:54:57.699408 dv-cinder-777031-14-iscsi devstack@n-api.service[118216]: Thu May 12 14:54:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!